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THE UNREASONABLE EFFECTIVENESS OF NONSTANDARD 

ANALYSIS 

SAM SANDERS 


Abstract. As suggested by the title, the aim of this paper is to uncover the 
vast computational content of classical Nonstandard Analysis. To this end, 
we formulate a template €3 which converts a theorem of ‘pure’ Nonstandard 
Analysis, i.e. formulated solely with the nonstandard definitions (of continu¬ 
ity, integration, differentiability, convergence, compactness, et cetera), into the 
associated effective theorem. The latter constitutes a theorem of computable 
mathematics no longer involving Nonstandard Analysis. To establish the vast 
scope of €7, we apply this template to representative theorems from the Big 
Five categories from Reverse Mathematics. The latter foundational program 
provides a classification of the majority of theorems from ‘ordinary’, that is 
non-set theoretical, mathematics into the aforementioned five categories. The 
Reverse Mathematics zoo gathers exceptions to this classification, and is stud¬ 
ied in [TOirn] using CCJ. Hence, the template £3 is seen to apply to essentially 
all of ordinary mathematics, thanks to the Big Five classification (and associ¬ 
ated zoo) from Reverse Mathematics. Finally, we establish that certain ‘highly 
constructive’ theorems, called Herbrandisations, imply the original theorem of 
Nonstandard Analysis from which they were obtained via £3. 


1. Introduction 

As suggested by the title, our aim is to uncover the vast computational content 
of (classical) Nonstandard Analysis. The following quotes serve as a good starting 
point of and motivation for our enterprise. 

It has often been held that nonstandard analysis is highly non¬ 
constructive, thus somewhat suspect, depending as it does upon the 
ultrapower construction to produce a model [... ] On the other hand, 
nonstandard praxis is remarkably constructive; having the extended 
number set we can proceed with explicit calculations. (Emphasis in 
original: [TJ p. 31]) 

Those who use nonstandard arguments often say of their proofs 
that they are “constructive modulo an ultrafilter”; implicit in this 
statement is the suggestion that such arguments might give rise to 
genuine constructions. f |631 p. 494]) 

Similar observations are made in [35l|4Tl[57l[58l|6Tl|64l|^[78l[85l|86l|88]. The reader 
may interpret the word constructive as the mainstream/classical notion ‘effective’, 
or as the foundational notion from Bishop’s Construetive Analysis m)- As will 
become clear, both cases will be treated below (and separated carefully). 
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To uncover the computational content of Nonstandard Analysis alluded to in 
the above quotes, we shall introduce a template £3 in Section [33] which converts 
a theorem of pure Nonstandard Analysis into the associated ‘constructive’ theo¬ 
rem; Here, a theorem of ‘pure’ Nonstandard Analysis is one formulated solely with 
the nonstandard definitions (of continuity, convergence, etc) rather than the usual 
‘epsilon-delta’ definitions. We shall make use of the classification provided by Re¬ 
verse Mathematics (See Section 12.21) to establish that the scope of the template 
£3 includes most of non-set theoretical mathematics. In view of this huge scope, 
the ‘unreasonable effectiveness of Nonstandard Analysis’ is no exaggeration, and 
even comes as a surprise in light of the claims by Bishop and Connes regarding the 
constructive nature of Nonstandard Analysis, as discussed in Section jS] We discuss 
the aim of this paper in detail in Section (TT] by way of an elementary example. 

On a historical note, the late Grigori Mints has repeatedly pushed the author to 
investigate the computational content of classical Nonstandard Analysis. In partic¬ 
ular, Mints conjectured the existence of results analogous or similar to Kohlenbach’s 
proof mining program ( [45] 1. The latter program has its roots in Kreisel’s pioneer¬ 
ing work on the ‘unwinding’ of proofs, where the latter’s goal is similar to ours: 

To determine the constructive {recursive) content or the construc¬ 
tive eguivalent of the non-constructive concepts and theorems used 
in mathematics, particularly arithmetic and analysis. (Emphasis in 
original on [321 P- 155]) 

We discuss the connection of our results to proof mining in Section 14.1.41 below. In 
particular, we show how the well-known limitations of the proof mining of classical 
mathematics are avoided by studying pure (classical) Nonstandard Analysis. 

Finally, Horst Osswald has qualified the observation from the above quotes as 
Nonstandard Analysis is locally constructive, to be understood as the fact that the 
mathematics performed in the nonstandard world is highly constructive while the 
principles needed to ‘jump between’ the nonstandard world and usual mathematics, 
are highly non-constructive in general (See [88l §7], [57l §1-2], or [58l §17.5]). The 
results in this paper shall be seen to vindicate both the Mints and Osswald view. 

1.1. Aim and results. In this section, we discuss the aim of this paper in more 
detail. Conceptually speaking, the aim of this paper is to formulate a template £3 
which takes as input the proof of a mathematical theorem from ‘pure’ Nonstandard 
Analysis, i.e. formulated solely with nonstandard definitions (of continuity, inte¬ 
gration, differentiability, convergence, ...), and outputs a proof of the associated 
effective version of this theorem. The template £3 works on proofs inside Nelson’s 
syntactic approach to Nonstandard Analysis, called internal set theory. The latter 
was first introduced in [5S] and discussed in Section 12.1.11 We make essential use 
of the results in [7] , as discussed in Section 12.1.21 

Intuitively speaking, the ‘effective version’ of a mathematical theorem is ob¬ 
tained by replacing all its existential quantifiers by functionals providing the ob¬ 
jects claimed to exist. In other words, the object claimed to exist by the theorem 
at hand can be computed (in a specific technical sense) from the other data present 
in the theorem. We believe our aim to be best further illustrated by way of an 
example, as follows. 
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Example 1.1. Assuming basic familiarity with Nelson’s internal set theory (See 
Section l2.1.ip . we illustrate our aim using the theorem: A uniformly continuous 
function on the unit interval is Riemann integrable there. The previous theorem 
formulated with the nonstandard definitions of continuity and integration is: 

(V/ : R ^ R)[{yx,ye [0,l])[a: fsi y ^ f{x) ss /(y)] (1.1) 

^ (Vtt, V e p([o, i]))(|k||, Ik'll 0 ^ SM) ~ s^,if))], 

where as suggested by the notation, tt and tt' are discrete partitions of the unit 
interval, and ||7r|| is the mesh of a partition, i.e. the largest distance between two 
adjacent partition points; The number 5'7r(/) is the Riemann sum associated with 
the partition tt, i.e. fiti){xi-Xi+i) for tt = (0, to,a:i, ti,..., xm-i, tM-i, !)• 


By contrast, the effective version of the theorem is as follows: 


(V/ : R ^ R, g, n) (Vx, y G [0,1], /c)(|x - y\ < ^ ^ \f{x) - fiy)\ < 1) (1.2) 

^ (Vtt,^' G P([0, l]))(||7r||. Ill'll < ^ ^ \SM) - S.,{f)\ < i) 


where t is primitive recursive (in the sense of Godel’s T; See Section [5|). Note that 
(nm does not involve Nonstandard Analysis. In Section 13.11 we show how a proof of 
the nonstandard version (EB) can be converted into a proof of the effective version 
(1121); Furthermore, the term t in dO]) can be ‘read off’ from the proof of dnj. 
Essential to this enterprise is the formal system P introduced in Section 12.11 The 
system P from [7] is a fragment of Nelson’s internal set theory based on Gddel’s 
system T (See [31I3D] for the latter). 


The previous example illustrates the goal of our paper; In general, we wish to 
formulate a template to convert the proof inside P of a mathematical theorem 
formulated solely using nonstandard definitions (of continuity, integration, differ¬ 
entiability, convergence, compactness, et cetera) as in (11.11) into a proof of the 
associated effective version as in (11.21) , in which all existential quantifiers have been 
removed. We shall formulate this template O in Section 13.51 and apply it to a 
number of mathematical theorems in Sections [3] and |4l In particular, we study 
representative theorems from the Big Five categories of Reverse Mathematics] The 
latter foundational program is introduced in Section 12.21 Exceptions to the Big 
Five categories are gathered in the Reverse Mathematics zoo, and are studied in 
[ 701171 ] using €3. Thus, the scope of our template is seen to include essentially the 
whole of ordinary, that is non-set theoretical, mathematics. 

Furthermore, it turns out that deriving the effective from the nonstandard ver¬ 
sion of a mathematical theorem, can often be done inside Bishop’s Constructive 
Analysis m), as is clear from e.g. Gorollarv 13.71 in Section [XT] This is surprising 
as such a derivation (of the effective version from the nonstandard one) involves 
bringing the quantifiers implicit in ‘w’ (as in e.g. (HU) to the front, which in gen¬ 
eral requires a non-constructive principle called independence of premises. Essential 
to this constructive development is the formal system H, which is the constructive 
version of P, as discussed in detail in Section 

In the case of compactness, multiple different nonstandard formulations are pos¬ 
sible, as discussed in Section 14.21 When running the first formulation through the 
template O, one rediscovers totally boundedness, the preferred notion of compact¬ 
ness in constructive and computable analysis (See Section [4.2.21 and 14.2.31) . When 
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running the second formulation (See Section 14.2.4|) through the template O, one 
rediscovers certain equivalences from Reverse Mathematics. These equivalences are 
even explicit. In general, running non-explicit equivalences (usually having very 
simple proofs) between nonstandard theorems through £3, one obtains explicit Re¬ 
verse Mathematics equivalences, as discussed in Sections lCTl4.2.4[ 14.3114.51 and l4.61 

A natural question in light of the aforementioned results is whether there is an 
effective theorem which derives from the nonstandard theorem and also vice versa, 
i.e. Can we re-obtain the nonstandard version from a suitable effective version? 
To this end, we introduce the notion of Herbrandisation of a nonstandard theorem. 
This ‘highly constructive’ version is derived from the original nonstandard theorem, 
and in turn implies the latter. Thus, we establish an ‘algorithmic’ two-way street 
between ‘soft’ analysis dealing with qualitative analysis (in the guise of Nonstandard 
Analysis) and ‘hard’ analysis dealing with quantitative results (embodied by the 
Herbrandisations). These results are discussed in detail in Sections 13.11 and 14.11 

In a nutshell, we formulate a template £U in this paper which converts (a proof of) 
a theorem in ‘pure’ Nonstandard Analysis, i.e. formulated solely with nonstandard 
definitions, into (a proof of) the ‘constructive’ version of the associated theorem. We 
show that this template applies to most of ordinary mathematics, as captured by the 
Big Five categories of Reverse Mathematics. Hence, we observe that Nonstandard 
Analysis is indeed ‘unreasonably effective’, as suggested by the title. 

Finally, the results in this paper should be contrasted with the current ‘main¬ 
stream’ view of Nonstandard Analysis: One usually thinks of the universe of stan¬ 
dard objects as ‘the usual world of mathematics’, which can be studied ‘from the 
outside’ using nonstandard objects such as infinitesimals. In this richer framework, 
proofs can be much shorter than those from standard (=non-Nonstandard) analy¬ 
sis; Furthermore, there are conservation results guaranteeing that theorems of usual 
mathematics proved using Nonstandard Analysis can also be proved without using 
Nonstandard Analysis. Thus, the starting and end point (according to the main¬ 
stream view) is always the universe of standard objects, i.e. usual mathematics. 
By contrast, our starting point is pure Nonstandard Analysis and our end point is 
constructive mathematics. 

1.2. Methodology. In this section, we discuss the methodology used in this pa¬ 
per. In particular, we try to explain why we observe the close connection between 
the nonstandard and effective versions of mathematical theorems. The following 
argument is somewhat vague but can (and will) be formalised using the formal 
systems P or H from [7], which in turn will be introduced in Section [2l 

(1) First of all, the nonstandard definitions of common notions (such as con¬ 
tinuity, integrability, convergence, et cetera) in Nonstandard Analysis can 
be brought into the ‘normal form’ (y^^x){3^^y)ip(x,y), where ip is internal, 
i.e. does not involve ‘st’. This can always be done in P and usually in H. 

(2) Secondly, the aforementioned ‘normal form’ is closed under modus ponens: 
Indeed, it is not difficult to show that an implication of the form: 

(V"^xo)(3"^2/o)‘Po(^o,2/o) ^ 


^An implication (34>)A($) —>• (3^)S(’If) is explicit if there is a term t in the language such 
that additionally (V4>)[A(<I>) i3(t(<I>))], i.e. can be explicitly defined in terms of <t>. 
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can also be brought into a normal form y). Hence, it seems 

theorems formulated solely with nonstandard definitions can be brought 
into the latter normal form. This can always be done in H and P. 

(3) Thirdly, the normal form (V®‘a;)(3®*?/)(p(a;, j/) has exactly the right structure 
to yield the effective version {\/x)(p{x, t{x)). In particular, from the proof of 
the normal form (y^'^x){3‘^^y)ip{x,y) (inside H or P), a term s can be ‘read 
off’ such that (Va:)(3y € s(x))(p(x, y) has a proof inside a system involving 
no Nonstandard Analysis. The term t is then defined in terms of s. 

It goes without saying that most technical details have been omitted from the above 
sketch, this in order to promote intuitive understanding. Nonetheless, the previous 
three steps form the skeleton of the template O introduced in Section [T5] For the 
remainder of this paper, he notion of ‘normal form’ shall always refer to a formula 
of the form {\/^^x){3^^y)(p{x,y) with (p internal, i.e. without ‘st’. 

In light of the previous observations, the class of normal forms, and hence the 
scope of O, seems to be very large. On a related note, we show in Section l4.1.4l that 
a well-known limitation to the proof mining of classical mathematics (See [45l §2.2, 
p. 22]) does not apply to O. 


2. Background 

In this section, we provide some background concering Nelson’s internal set the¬ 
ory and Friedman’s foundational program Reverse Mathematics. 

2.1. Internal set theory and its fragments. In this section, we discuss Nelson’s 
internal set theory^ first introduced in |55j , and its fragments P and H from [7] . The 
latter fragments are essential to our enterprise, especially Corollary 12.51 below. 

2.1.1. Internal set theory 101. In Nelson’s syntactic approach to Nonstandard Anal¬ 
ysis ([55]), as opposed to Robinson’s semantic one ((6^), a new predicate ‘st(a:)’, 
read as ‘a; is standard’ is added to the language of ZFC, the usual foundation of 
mathematics. The notations (V®*a;) and (3®*y) are short for (Va;)(st(a;) -^ ...) and 
(3?/)(st(i/) A ...). A formula is called internal if it does not involve ‘st’, and exter¬ 
nal otherwise. The three external axioms Idealisation, Standard Part, and Transfer 
govern the new predicate ‘st’; They are respectively definec0 as: 

(I) (V®‘ ^'^x){3y){'dz € x)ip{z,y) —>• (3y)(y‘^^x)(p{x,y), for internal p with any 
(possibly nonstandard) parameters. 

(S) (V"*a:)(3"‘?/)(V"*z)((z &x A p{z)) o z e y), for any p. 

(T) (V®‘t)[(V®*a;):^(x,<) —>■ (yx)p{x,t)\, where p{x,t) is internal, and only has 
free variables t,x. 

The system 1ST is (the internal system) ZFC extended with the aforementioned 
external axioms; The former is a conservative extension of ZFC for the internal 
language, as proved in |55) . 

In [7], the authors study Godel’s system T extended with special cases of the 
external axioms of 1ST. In particular, they consider the systems H and P, intro¬ 
duced in the next section, which are conservative extensions of the (internal) logical 
systems E-HA“ and E-PA‘‘^, respectively Heyting and Peano arithmetic in all finite 
types and the axiom of extensionality. We refer to [H] §3.3] for the exact definitions 

^The superscript ‘fin’ in (I) means that x is finite, i.e. its number of elements are bounded by 
a natural number. 





6 


THE UNREASONABLE EFFECTIVENESS OF NONSTANDARD ANALYSIS 


of the (mainstream in mathematical logic) systems E-HA*^ and E-PA‘^. Furthermore, 
E-PA"^* and E-HA“* are the definitional extensions of E-PA“ and E-HA"^ with types 
for finite sequences, as in [71 §2]. For the former systems, we require some notation. 

Notation 2.1 (Finite sequences). The systems E-PA“* and E-HA*^* have a dedi¬ 
cated type for ‘finite sequences of objects of type p\ namely p*. Since the usual 
coding of pairs of numbers goes through in both, we shall not always distinguish 
between 0 and 0*. Similarly, we do not always distinguish between ‘s'” and ‘(s'’)’, 
where the former is ‘the object s of type p\ and the latter is ‘the sequence of type 
p* with only element s'”. The empty sequence for the type p* is denoted by ‘Op’, 
usually with the typing omitted. Furthermore, we denote by ‘|s| = n’ the length of 
the finite sequence s'’ = (sq, s^*, ..., s0_]^), where |()| =0, i.e. the empty sequence 
has length zero. For sequences s'’ ,t'’ , we denote by ‘s * F the concatenation of s 
and t, i.e. (s * t){i) = s{i) for i < |s| and (s t){j) = t(|s| — j) for |s| < j < |s| -I- |t|. 
For a sequence s'’ , we define sN := (s(0), s(l),..., s(N)) for iV° < |s|. For a 
sequence we also write aN = {a{Q),a{l),... ,a{N)) for any N°. By way 

of shorthand, G Q'’ abbreviates {3i < |Q|)(Q(i) =p <?)■ Finally, we shall use 
x,y,t,... as short for tuples Xg°,... of possibly different type ai. 

2.1.2. The classical system P. In this section, we introduce the system P, a conser¬ 
vative extension of E-PA’’’ with fragments of Nelson’s 1ST. 

To this end, we hrst introduce the base system E-PA^^*. We use the same defini¬ 
tion as III Def. 6.1], where E-PA*^* is the definitional extension of E-PA*^ with types 
for hnite sequences as in [71 §2]. The set T* is defined as the collection of all the 
constants in the language of E-PA'’’*. 

Definition 2.2. The system E-PA“^* is defined as E-PA’’’* -f where 7^* 

consists of the following axiom schemas. 

(1) The schemrd st(x) Ax = y ^ st{y), 

(2) The schema providing for each closed term t € T* the axiom st(t). 

(3) The schema st(/) A st(a:) st{f{x)). 

The external induction axiom lA®* is as follows. 

$(0) A (V'’‘n°)($(n) ^ $(n -f 1)) ^ (WV°)$(n). (lA’’*) 

Secondly, we introduce some essential fragments of 1ST studied in |7]. 

Definition 2.3. [External axioms of P] 

(1) HACint: For any internal formula </?, we have 

0f^xP){3^YMx,y) -A (3^‘F'’-"*)(W‘:r'’)(3y" G F{x)Mx,y), (2.1) 

(2) I: For any internal formula <p, we have 

(V"*a;'**)(3y^)(Vz'’’ G x)ip{z,y) {3y^){\/^^x'^)(p{x,y), 

(3) The system P is E-PA“j* -f I + HACint- 

Note that I and HACjnt are fragments of Nelson’s axioms Idealisation and Stan¬ 
dard part. By definition, F in (EH) only provides a finite sequence of witnesses to 
(3®*?/), explaining its name Herbrandized Axiom of Choice. 

^The language of E-PA^* contains a symbol st^ for each finite type cr, but the subscript is 
essentially always omitted. Hence 7^^ is an axiom schema and not an axiom. 
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The system P is connected to E-PA“ by the following theorem. Here, the su¬ 
perscript ‘5'st’ is the syntactic translation defined in [71 Def. 7.1], and also listed 
starting with (12.61) in the proof of Corollarv l2.5l 

Theorem 2.4. Let $(a) be a formula in the language of E-PA^^* and suppose 
ip{x,y,gf). If A^t is a collection of internal formulas and 

P + ^int P (2-2) 

then one can extract from the proof a sequence of closed terms t in T* such that 
E-PA"^* -P Ajnt b yx3y € t{x) <p{x,y,a). (2-3) 

Proof. Immediate by [71 Theorem 7.7]. □ 

The proofs of the soundness theorems in [71 §5-7] provide an algorithm A to 
obtain the term t from the theorem. In particular, these terms can be ‘read off’ 
from the nonstandard proofs. 

In light of Section 11.21 the following corollary (which is not present in [7] ) is 
essential to our results. Indeed, the following corollary expresses that we may obtain 
effective results as in ( 1 ^ from any theorem of Nonstandard Analysis which has 
the same form as in (|2.4I) . In Sections |3l and IH we show that the scope of this 
corollary includes the Big Five systems of Reverse Mathematics (See Section [2?^ . 

Corollary 2.5. If A\„t is a collection of internal formulas and ip is internal, and 

P -f Aipt b (V®V)(3’'‘y)i/>(x,y,a), (2.4) 

then one can extract from the proof a sequence of closed terms t in T* such that 
E-PA"’* + QF-ACi’° 4- Aint b (Vs)(3y e t{x))iP{x,y,a). (2.5) 

Proof. Clearly, if for internal ip and <l>(a) = {\/^*'x){3‘^^y)ip{x, y, a), we have [$(a)]‘®'** = 
<i>(a), then the corollary follows immediately from the theorem. A tedious but 
straightforward verification using the clauses (i)-(v) in [7) Def. 7.1] establishes that 
indeed $(a)‘®‘’* = <I>(a). For completeness, we now list these five inductive clauses 
and perform this verification. 

Hence, suppose $(a) and 4'(&) in the language of P have the interpretations 

= {'^^*^x){3‘^*^y)(p{x,y,a) and = (V®*u)(3’*‘’z;)'(/;(m, w, 6 ), ( 2 . 6 ) 

for internal ip, (p. These formulas then behave as follows by [71 Def. 7.1]: 

(i) ip^^^ := Ip for atomic internal ip. 

(ii) (st(z))^" := (3"‘cc)(z = a;). 

(iii) (-><i))‘®'*‘ := (V®*F)(3®*’x)(V?/ &Y_[j^)-'ip{x,y,gP). 

(iv) ($ V vl')‘5=t := {y^^x,u){3‘^*y,v)[(p{x,y,a) V ipiu,v,b)] 

(v) := (V^‘x)(3^‘y)(Vz)(3y' e y)v 7 (x,y',z) 

Hence, fix <i>o(a) = x){3^^y)ipo{x, y, of) with internal ipo, and note that = (p 

for any internal formula. We have [st(?/)]'^=‘ = (3®*rc)(;u; = y) and also 

[-'St(y)]'^''‘ = (V®*]T)(3’**’x)(Vw G W[x\)^{ui = y) = (V®*w)(n; 7 ^ y). 

Hence, [-'St(y) V -^ipo(x,y,a)]^‘^ is just (V®V)[(m1 7 ^ y) V -^ipo{x,y,a)], and 

[(Vy)hst(y) V -'V’o(^,y,a)]]'^"‘ = (V"V)(3 ’'*u)(V|;)(3i;' G v)[w yM ^ipQ{x,y, a)]. 
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which is just (V®*w;)(Vj/)[(r; y) V “'i/'ofe J/;o)]- Furthermore, we have 

[(3"*y)V'ofey,a)]'^"‘ = [-'(Vy)[-.st(y) V 

= (V‘'V)(3"‘w)(Vt G F[w])-'[(Vy)[(w j^y)V -'V'ofe, y, a)]]- 
= (3"V)(3y)[(w =y) AV'ofey.a)]] = {'^''^w)ipo{x,w,a). 

Hence, we have proved so far that (3®*y)i/)o(a;, y, a) is invariant under S'st- By the 
previous, we also obtain: 

[-'St(®) V (3''*y)'!/)o(x,y,a)]'®"* = x)V ^o{x,w,a)]. 

Our final computation now yields the desired result: 

[(V"‘x)(3"*y)V'ofe,y,a)]'^'“ = [(V^)(-.st(x) V (3"*y)V'ofe y, a))] 

= (V®*21lO(3’’*w)(Vir)(3w" G w)[{w' ^ x)\/ tpo{x,u/',a)]. 
= {V^^w'){3‘^^w){3w" G w)'iIjo{w', w!',a). 

The last step is obtained by taking x = w'- Hence, we may conclude that the 
normal form (V®*x)(3®‘y)'!/)o(^, y,a) is invariant under Sst, and we are done. □ 

For the rest of this paper, the notion ‘normal form’ shall refer to a formula as in 
dZl, i.e. of the form (y^'^x)(3^^y)ip{x,y) for tp internal. 

Finally, the previous theorems do not really depend on the presence of full Peano 
arithmetic. We shall study the following subsystems. 

Definition 2.6. 

(1) Let E-PRA*^ be the system defined in (40 §2] and let E-PRA‘^* be its defi¬ 
nitional extension with types for finite sequences as in [3 §2]. 

(2) (QF-AC^’’') For every quantifier-free internal formula p{x,y), we have 

{Vxf‘)(3y'^)(p{x,y) {3FP^^){VxP)p{x, F{x)) (2.7) 

(3) The system RCA;^( is E-PRA"^ + QF-ACAO. 

The system RCAq is the ‘base theory of higher-order Reverse Mathematics’ as 
introduced in [?S1 §2]. We permit ourselves a slight abuse of notation by also 
referring to the system E-PRA‘^* + QF-AC^’° as RCAq . 

Corollary 2.7. The previous theorem and corollary go through for P and E-PA‘‘’* 
replaced by Pq = E-PRA“* + 7;t + HACint + I -F QF-AC^o and RCA“. 

Proof. The proof of [3 Theorem 7.7] goes through for any fragment of E-PA*^* 
which includes EFA, sometimes also called lAg-l-EXP. In particular, the exponential 
function is (all what is) required to ‘easily’ manipulate finite sequences. □ 

We now discuss the Standard Part principle H-CA, a very practical consequence 
of the axiom FIACint- Intuitively speaking, H-CA expresses that we can obtain the 
standard part (in casu G) of Cl-invariant nonstandard objects (in casu F{-,M)). 
Note that we write ‘N G H’ as short for -ist(A°). 

Definition 2.8. [H-invariance] Let standard and fix G H. Then 

F{-,M) is H-invariant if 

(V’^‘x‘")(VN° G n)[F{x,M) =0 F{x,N)]. 


( 2 . 8 ) 
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Principle 2.9 (Sl-CA). Let standard and fix G ft. For every 

fi-invariant F{-,M), there is a standard such that 

(V'^*a;'")(ViV° e n) [G{x) =o F{x, A^)]. (2.9) 

The axiom fl-CA provides the standard part of a nonstandard object, if the latter 
is independent of the choice of infinite number used in its definition. 

Theorem 2.10. The system Pq proves il-CA. 

Proof. We sketch the derivation of il-CA from HACint. Let F{-, M°) be il-invariant, 
i.e. we have 

M° G Tl) [F(a;, M) =o F{x, TV)]. (2.10) 

We immediately obtain (any infinite will do) that 

(V’^‘x'")(3/fc°)(ViV°,M° > k)[F{x,M) =0 F{x,N)]. 

By the induction axioms present in Pq, there is a least such k for every standard 
a;®’. By our assumption (12.101) . such least number k^ must be standard, yielding: 

(V’^‘a:‘")(3"*fc°)(ViV°,M° > k)[F{x,M) =o F{x,N)], 

which we could also have obtained via underspill (See [71 Prop. 5.11]). Now apply 
HACint to obtain standard <1)'^“*'° such that 

(W*a;'")(3fc° G <i>{x)){VN°,M° > k)[F{x,M) =o F{x,N)]. 

Next, define ^'(a:) := maxi<|$(a;)| <i)(a;)(z) and note that 

(W*a;'")(VAf°,M° > 4'(a;)) [F(a;, M) =o F{x,N)]. 

Finally, put G{x) := F{x, 'I'(x)) and note that fl-CA follows. □ 

Finally, we note that Ferreira and Caspar present a system similar to P in 
which however is less suitable for our purposes. 

2.1.3. The constructive system H. In this section, we define the system H, the 
constructive counterpart of P. The system H was first introduced in [71 §5.2], and 
constitutes a conservative extension of Heyting arithmetic E-HA“ by [71 Cor. 5.6]. 
We now study the system H in more detail. 

Similar to Definition [721 we define E-HA“^* as E-HA*^* + 7^^ + lA'**, where E-HA“* 
is just E-PA“* without the law of excluded middle. Furthermore, we define 

H = E-HA“* + HAC + I + NCR + HlPy^t + HGMP"*, 

where HAC is HACint without any restriction on the formula, and where the remain¬ 
ing axioms are defined in the following definition. 

Definition 2.11. [Three axioms of H] 

(1) HlPyst 

\{^^x)m -G (3^‘2/)^(2/)] ^ (3^‘2/')[(V^*^)<('(^) ^ (32/ e 2/')'I^(2/)l, 

where ^'(i/) is any formula and (f{x) is an internal formula of E-HA"^*. 

(2) HGMP"* 

[(V'**x)(/)(a:) fj] ^ (3®*a;')[(Vx G x')(j){x) ip] 
where (j>{x) and ip are internal formulas in the language of E-HA“*. 
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(3) NCR 

(V2/’')(3’’*a;'’)$(a;,j/) ^ S x)<^{x',y), 

where $ is any formula of E-HA“* 

Intuitively speaking, the first two axioms of Definition 12.111 allow us to perform 
a number of non-constructive operations (namely Markov’s principle and indepen¬ 
dence of premises) on the standard objects of the system H, provided we introduce a 
‘Herbrandisation’ as in the consequent of MAC, i.e. a finite list of possible witnesses 
rather than one single witness. Furthermore, while H includes idealisation I, one 
often uses the latter’s classical contraposition, explaining why NCR is useful (and 
even essential) in the context of intuitionistic logic. We discuss the constructive 
nature of the axioms from Definition 12.111 in more detail in Remark 13.81 

Surprisingly, the axioms from Definition 12.111 are exactly what is needed to con¬ 
vert nonstandard definitions (of continuity, integrability, convergence, et cetera) 
into the normal form (V®*a;)(3®*j/)(^(a:, y) for internal ip, as is clear from e.g. Corol- 
larv l3.7l The latter normal form plays an equally important role in the constructive 
case as in the classical case by the following theorem. 

Theorem 2.12. If A\nt is a collection of internal formulas, ip is internal, and 

H-b Aint F V’**£3’’‘y(^(x,y,a), (2.11) 

then one can extract from the proof a sequence of closed terms t in T* such that 
E-HA"^* -b Aint F Vx3i/ G t(x) ip(x,y,a)- (2-12) 

Proof. Immediate by [71 Theorem 5.9]. Note that in the latter, just like in the 
proof of Corollarv l2.51 3®*y ip{x, y, a) is proved to be ‘invariant’ under a suitable 
syntactic translation. □ 

The proofs of the soundness theorems in [71 §5-7] provide an algorithm B to 
obtain the term t from the theorem. Finally, we point out one very useful principle 
to which we have access. 

Theorem 2.13. The systems P, H, and Pq prove overspill, i.e. 

{Y^xP)ip{x) {3yP) [-.st(j/) A ip{y)], (OS) 

for any internal formula ip. 

Proof. See [71 Prop. 3.3]. □ 

In conclusion, we have introduced the systems H, P, which are conservative 
extensions of Peano and Heyting arithmetic with fragments of Nelson’s internal set 
theory. We have observed that central to the conservation results (Corollary 12.51 
and Theorem 12.411 is the normal form (\f’^^x){3’^*‘y)ip{x,y) for internal ip. 

2.1.4. Notations. In this section, we introduce notations relating to H and P. 

First of all, we mostly use the same notations as in |7]. 

Remark 2.14 (Notations). We write (V®*ai'’’)<l?(a;'’’) and (3®*x'^)'I'(a:‘’’) as short for 
(Vcc"’’) [st(a;'’’) —)• $(a;'’’)] and (d®*^'’’) [st(a:‘’’) A'k(a:‘^)]. We also write (Vx° S 
and (3a;° G n)'I'(a:°) as short for (Vx°) [-'St(x°) —5> $(a;°)] and (3a;°) [-'St(a;°) A 
'I'(ai°)]. Furthermore, if -'St(a:°) (resp. st(a:°)), we also say that x^ is ‘infinite’ 
(resp. finite) and write ‘x° G 12’. Finally, a formula A is ‘internal’ if it does not 
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involve st, and A®* is defined from A by appending ‘st’ to all quantifiers (except 
bounded number quantifiers). 

Secondly, we will use the usual notations for natural, rational and real numbers 
and functions as introduced in [46l p. 288-289]. (and [TU 1.8.1] for the former). We 
only list the definition of real number and related notions. 

Definition 2.15 (Real numbers and related notions). 

(1) A (standard) real number x is a (standard) fast-converging Cauchy sequence 
< 7 ^^.^, i.e. (Vn°,i°)(|q„ — qn+i)\ <o ^)- We use Kohlenbach’s ‘hat function’ 
from Uni P- 289] to guarantee that every sequence is a real. 

(2) We write [x](fc) := qk for the fc-th approximation of a real x^ = (9(.))- 

(3) Two reals x,y represented by (?(.) and r(.) are equal, denoted x =ir y, if 
(Vn)(|( 7 „ — r„| < ^). Inequality <ir is defined similarly. 

(4) We write x y ii (V’*‘n)(| 9 „ — < ^) and x ^ y x > y A x ^ y. 

(5) Functions F : IR —)• IR mapping reals to reals are represented by functionals 

niapping equal reals to equal reals, i.e. 

(Vx, y)(x =R y$(x) =|R $(?/)). (RE) 

(6) For a space X with metric ] • ]jc : X —>■ IR, we write ‘x « y' for ‘|x —y|x ~ O’. 

(7) Sets of objects of type p are denoted ,... and are given 

by their characteristic functions i.e. (Vx^)[x S X CA fx{x) =o 1], 

where is assumed to output zero or one. 

Note that ‘x « y' for points x,y € X can also be defined if a collection D of 
‘basic open sets’ of X is given (without reference to a metric). Indeed, given such 
a collection D, ‘x « y’ is just (V®*0 £ i5)(a; G O -H- y G O). 

Thirdly, we use the usual extensional notion of equality. 

Remark 2.16 (Equality). All the above systems include equality between natural 
numbers ‘=o’ as a primitive. Equality ‘=t-’ for type r-objects x,y is defined as: 

[x =r y] = (Vzp ... zl'‘)[xzi... Zk =0 yzi ■ ■. Zk] (2.13) 

if the type r is composed as r = (n Tfc —>• 0). In the spirit of Nonstandard 

Analysis, we define ‘approximate equality as follows: 

[x y] = (V’'*zp ... zl'’)[xzi... Zk =0 yzi... Zk] (2.14) 

with the type t as above. All the above systems include the axiom of extensionality 
for all as follows: 

(Vx^,y^)[x =p y ^ 7 j(x) (^(y)]. (E) 

However, as noted in m P- 1973], the so-called axiom of standard extensionality 
is problematic and cannot be included in our systems. Einally, a functional 
jg palled an extensionality functional for if 

(Vfc, /\ y^) [7S(/, g, k) =o gS(/, g, k) >p{f)k =o <p{g)k ], (2.15) 

i.e. S witnesses © for ip. As will become clear in Section 14.11 standard exten¬ 
sionality is translated by our template O into the existence of an extensionality 
functional, and the latter amounts to no more than an unbounded search. 
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2.2. Reverse Mathematics 101. Reverse Mathematics (RM) is a program in 
the foundations of mathematics initiated around 1975 by Friedman ([MIES]) and 
developed extensively by Simpson f [731174) 1 and others. The aim of RM is to find the 
axioms necessary to prove a statement of ordinary mathematics, i.e. dealing with 
countable or separable objects. The classical base theory RCAq of ‘computabl^l 
mathematics’ is always assumed. Thus, the aim of RM is as follows: 

The aim of RM is to find the minimal axioms A such that RCAq 

proves [A —>■ T] for statements T of ordinary mathematics. 

Surprisingly, once the minimal axioms A have been found, we almost always also 
have RCAo h [A -h- T], i.e. not only can we derive the theorem T from the axioms 
A (the ‘usual’ way of doing mathematics), we can also derive the axiom A from the 
theorem T (the ‘reverse’ way of doing mathematics). In light of the latter, the field 
was baptised ‘Reverse Mathematics’. 

Perhaps even more surprisingly, in the majorit}0 of cases for a statement T of 
ordinary mathematics, either T is provable in RCAq, or the latter proves T Ai, 
where A^ is one of the logical systems WKLq, ACAq, ATRq or n]-CAo. The latter 
together with RCAq form the ‘Big Five’ and the aforementioned observation that 
most mathematical theorems fall into one of the Big Five categories, is called the 
Big Five phenomenon l |52l p. 432]). Furthermore, each of the Big Five has a 
natural formulation in terms of (Turing) computability (See e.g. [74l F3.4, 1.5.4, 
1.7.5]). As noted by Simpson in [Til 1-12], each of the Big Five also corresponds 
(sometimes loosely) to a foundational program in mathematics. 

The logical framework for Reverse Mathematics is second-order arithmetic^ in 
which only natural numbers and sets thereof are available. As a result, functions 
from reals to reals are not available, and have to be represented by so-called codes 
(See [Ml n.6.1]). In the latter case, the coding of continuous functions amounts to 
introducing a modulus of (pointwise) continuity (See [13 §4]). The nonstandard 
theorems proved in the system P will not involve coding (for continuous functions or 
otherwise); However, as will become clear below, a modulus of continuity naturally 
‘falls out of’ the nonstandard definition of continuity as in (HU. In other words, 
the nonstandard framework seems to ‘do the coding for us’. 

In light of the previous, one of the main results of RM is that mathematical 
theorems fall into only five logical categories. By contrast, there are lots and lots 
of (purely logical or non-mathematical) statements which fall outside of these five 
categories. Similarly, most mathematical theorems from Nonstandard Analysis have 
the normal from required for applying term extraction via Corollary 12.51 while 
there are plenty of non-mathematical or purely logical statements which do not. 
In conclusion, the results in this paper are inspired by the Reverse Mathematics 
way of thinking that mathematical theorems (known in the literature) will behave 
‘much nicer’ than arbitrary formulas (even of restricted complexity). In particular, 
since there is no meta-theorem for the (Big Five and its zoo) classification of RM, 
one cannot hope to obtain a meta-theorem for the template €3 from Section 13.51 


^In Constructive Reverse Mathematics (ES), the base theory is based on intuitionistic logic. 
^The system RCAq consists of induction 7Ei, and the recursive comprehension axiom Aj-CA. 
^Exceptions are classified in the so-called Reverse Mathematics Zoo (ESI). 
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Finally, there is a tradition of Nonstandard Analysis in Reverse Mathematics 
and related topics (See e.g. [Ml[7^[7^811l921l94] l. which provides a source of proofs 
in (pure) Nonstandard Analysis for O as defined in Section 1X51 

3. Main results I: Continuity, integration, convergence, and 

DIFFERENTIABILITY 

In this section, we prove our first batch of results, namely we show how to convert 
nonstandard theorems dealing with the notions mentioned in the section title, into 
effective theorems no longer involving Nonstandard Analysis (and vice versa). 

We provide full details in the sections dealing with continuity, Riemann inte¬ 
gration, and limits, and then switch to less detailed sketches for the fundamental 
theorem of calculus and Picard’s theorem. These case studies allow us to formulate 
our template O in Section 13.51 The results in this section show that the template 
£3 applies to representative theorems of the base theory of Reverse Mathematics. 

3.1. Riemann integration. In this section, we study the statement CRI: A uni¬ 
formly continuous function on the unit interval is Riemann integrable. We first 
obtain the effective version of CRI from the nonstandard version inside Pq. We 
then obtain the same result in the constructive system H. Finally, we re-obtain the 
nonstandard version from a special effective version, called the Hehrandisation. 

3.1.1. Riemann integration in Pq. First of all, the ‘usual’ nonstandard definitions 
of continuity and integration are as follows. 

Definition 3.1. [Continuity] A function / is nonstandard continuous on [0,1] if 
(V®*x e [0, l])(Vj/ e [0, l])[x !=sy^ f{x) Ri f{y)]. (3.1) 

A function / is nonstandard uniformly continuous on [0,1] if 

(Vx,ye [0,l])[x Ki y ^ f{x) «/(?/)]. (3.2) 

Definition 3.2. [Integration] 

(1) A partition of [0,1] is any sequence tt = {0,to,xi,ti,... ,XM-i,tM-i,^)- 
We write ‘tt S P([0, 1])’ to denote that tt is such a partition. 

(2) For TT e P([0,1]), ||7r|| is the mesh, i.e. the largest distance between two 
adjacent partition points Xi and Xi+i. 

(3) For TT e P([0,1]) and / : R R, the real S'^(/) := fiti)ixi - Xi+i) 

is the Riemann sum of / and tt. 

(4) A function / is nonstandard integrable on [0,1] if 

(V^, tt' g P([0, 1])) [IIttII, ||V|| « 0 ^ SM) ^ SM)] ■ (3.3) 

Let CRIns be the statement (V/ : R —>■ R1[ (I3.2I1 —>• (I3.3|l ]. and let CRIef(t) be (II. 2|) . 
The latter statement is still quite natural: Kohlenbach has shown that continuous 
real-valued functions as represented in RM (See [74l II.6.6] and [45l Prop. 4.4]) 
automatically have a modulus of pointwise continuity. 

Theorem 3.3. From the proof o/CRIps in Pq, a term t can be extracted such that 
E-PRA"^* proves CRIef(t). 
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Proof. We first show that CRIns can be proved in Pq. Given two partitions tt = 

1) and tt' = (0, ..., 1) with in¬ 

finitesimal mesh, let x'f for i < M" be an enumeratiorQ of all Xi and x'^ in increasing 
order. Let t'f and t'" for i < M" be the associated ti and t'f with repetitions (cor¬ 
responding to x'l) of the latter to obtain a list of length M". Then we have that 

l^.(/) - S^,{f)\ = I - ^*+i) - - <+i)\ 

= I fifDWl - <+{) - E^E' /(E)« - ^Ei)l 

= IE;^E'(/(E)-/(C))-(E-^'Vi) 

< E^E' l/(E) - /(E)l • IE - ^Eil < E^E' • IE - x'Vil « 

where £q := maxi<M" \f(ti) — infinitesimal due to the (uniform non¬ 

standard) continuity of / and the definition of tt,tt' . Hence, we obtain CRI^s, from 
which we now derive CRIef(t). To this end, we show that CRIns can be brought 
into the normal form for applying Corollary 12.51 First of all, we resolve in the 
antecedent of CRIns as follows: 

(Vx,y e [0,l])[(V"‘A^)|x-y| < ^ ^ (V"‘fc)l/(E -/E)! < il- (3-4) 
Bringing all standard quantifiers in (13.411 outside the square brackets, we obtain: 

(V"*fc)(Vx,y G [0,l])(3"‘iV)[|x - j/l < ^ |/(x) - f{y)\ < (3.5) 

Since the formula in square brackets is internal in (13.51) . we may apply (the contra¬ 
position of) idealisation I and obtain 

(V"*fc)(3"*E*)(Vx,y G [0,l])(3Af G x)[\x-y\ < jj ^ |/(x) - f{y)\ < i]. (3.6) 

By defining iV° := maxi<| 3 ;| x{i), (13.61) becomes the following: 

(V«tfc)(3^‘W)(Vx,y G [0, l])(3iV < W)[|x - y\ < ^ ^ |/(x) - /(y)| < i], (3.7) 

which immediately yields, due to the ‘monotone nature’ of the formula, that 

(V"*fc)(3"t7V)[(Vx,2/ G [0,l])[|x-i/| < ^ l/(E -/(y)l < il]- (3-8) 

Since the formula in (big) square brackets is internal, we may apply HACjnt and 
obtain standard such that N G <i)(fc) in p.8l) . By defining g{k) to be the 

maximum of all components of 4>(fc), i.e. g{k) := maxj<|$(-fc)| d>(fc)(i), we obtain: 

(3"E)(V"‘A:)[(Vx,?/ G [0,l])[|x-?/| < ^ ^ l/(E -/(j/)! < i]] > (3-9) 

and let A(g, fc, /) be the (internal) formula in big square brackets. Similarly, the 
consequent of CRIns yields: 

(V«tA:')(3^*W)[(V^,7r' G P([0, l]))(||7r||, ||V|| < ^ ^ |5^(/) - 5^(/)| < i)], 

(3.10) 

where B{k', N', f) is the (internal) formula in square brackets. Then CRIps implies 
(V^E, fc')(V/)(3^*W, k)[Aig, k, f) ^ i?(fc', W, /)]. (3.11) 

Applying (the contraposition of) idealisation I to p.lip . we obtain 

(WEE')(Ex°‘)(V/)(37V',fc G x)[A{g,kJ) ^ B{k',N',f% (3.12) 

^To make this enumeration effective, work with the approximations [xi]{2^) and ) 

and note that the difference is infinitesimal in the below steps. 





THE UNREASONABLE EFFECTIVENESS OF NONSTANDARD ANALYSIS 


15 


which immediately yields, by defining := maxj<| 2 ,| x{i), that 

(V^‘g, fc')(3^‘0(V/)(3iV', k < l)[A{g, k, /) ^ B{k', N', /)], (3.13) 

Furthermore, by the monotone behaviour of B{k', •, /), we have that: 

(y^g, k')yy)iWf)iBk)[A{g, k, f) ^ B{k', N', /)]. (3.14) 

Applying Corollary 12.51 to (13.141) . the system E-PRA“* proves 

(Vg, k')i3N' G t{g, k'Wf){3k)[A{g, k, /) ^ B{k', N', /)], (3.15) 

for some term t from the original language. Define u{g, k') to be the maximum of 
the components of t{g,k'), i.e. u(g,k') := maxj<|((g/j/) t{g,k'){i), yielding: 

(V/,5, k'){3k)[Aig, fc, /) ^ B{k\ u{g, fc'), /)], (3.16) 

again by the special structure of B. Bringing all quantifiers inside again, we obtain 
(V/, gWk)A{g, k, /) ^ {W)Bik', u{g, k'), /)], (3.17) 

which is exactly CRIef(u) by the definitions of A and B. □ 


Note that the actual computation in CRIef(t) only takes place on the modulus 
g. Thanks to the previous theorem, we can define (inside E-PRA"^*) the Riemann 
integral functionao /(/, 0, x) which takes as input a modulus of uniform continuity 
g for / on [0,1] and outputs /p The aforementioned results are not really 

shocking, but what is surprising is the following: 

a) The straightforward derivation of the effective CRIgf from the nonstan¬ 
dard CRIns, especially given the claims from Section [5] regarding the non¬ 
constructive nature of Nonstandard Analysis. 

b) The uniformity of the derivation from a), i.e. a similar derivation should 
work for many other pairs of nonstandard and effective theorems. 

With regard to b), we mention the following two examples. 

Example 3.4. Two other theorems which can be treated exactly as in Theorem l3.3l 
are the Weierstrafl approximation theorem (See [731 IV.2.4]) and the statement that 
every uniformly continuous function on [0,1] has a supremum. We discuss the latter 
in more detail: First of all, a nonstandard uniformly continuous function / satisfies 

{\/x G [0,1], M G y[fix) ^ sup(/, M)] (3.18) 

where sup(/, M) = ||/||m := niaxi< 2 '^f [/(^)](2^) and [x]{k) is the fc-th approxi¬ 
mation of the real x. Secondly, the effective version, which can be derived from the 
nonstandard version in exactly the same way as in Theorem 13.31 is as follows. 

Theorem 3.5 (SUPef(t)). For every / : R —>■ IR with modulus of uniform continuity 
g on [0,1], we have (Va; G [0,1],A^ > t{g,n))[f{x) < snp{f,N) 3 - i]. 

As for the Riemann integral, we can now define the functional ||/|| = sup 3 .g[o_]^] f{x) 
where the modulus of uniform continuity is implicit. We will study (13.181) in the 
context of (nonstandard) compact spaces in Section 

Finally, we discuss the following remark regarding the use of idealisation I, 
HACint, and term extraction as in Corollarv l2.5l 

®In particular, [/(/, 0,a;)](A:) is defined as where i{x) is the least partition point 

larger than x. To guarantee that /(/, 0, x) converges ‘fast enough’, one considers [/(/, 0, x)]{t{g, k)) 
where g is a modulus of uniform continuity of / and t is the term from Theorem 13.31 
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Remark 3.6 (Using HACint and I). By definition, HACint produces a functional 
of type cr —^ T* which outputs a finite sequence of witnesses. Now, in the proof 
of Theorem 13.31 HACint is applied to (I3.8p to obtain , and from the latter, 

the function is defined as follows: g{x) := maxj<;|$( 3 ,)| <i)(a;)(i). In particular, g 
satisfies (EH), and provides a witnessing functional, due to the ‘monotone’ nature 
of the internal formula in (I3.8p . In general, HACint provides a witnessing functional 
assuming (i) r = 0 in HACint and (ii) the formula ip from HACint is ‘sufficiently 
monotone’ as in: (Va;'’’, n°, m^){\n <o m A <p{n, a;)] -A <p{m, x)). 

A similar observation applies to idealisation I; Indeed, consider (j3.5l) and note 
that the internal formula in the latter is monotone as above. Taking the maximum 
of X from (Ell) as N := maxj<| 3 ,| x{i), one can drop the quantifier ‘{3N G x)’ in 
(1^ to obtain (EH) and (EH)- 

A similar observation applies to terms obtained by term extraction] Indeed, 
consider (I3.15p and note that the internal formula in the latter is monotone as 
above. Taking the maximum of t from (j3.15p as u[g, k') := t{g^ k'){i), 

one can drop the quantifier ‘{3N' G t{g, fc'))’ in (13.1511 to obtain (13.161) and (|3.17p . 

To save space in proofs, we will sometimes skip the (obvious) step involving the 
maximum of the finite sequences, when applying HACint, I and term extraction. 

3.1.2. Riemann integration m H. In this section, we show that Theorem 13.31 also 
goes through for H and Heyting arithmetic. We point out that the convention from 
Remark EH also applies to the axioms of H from Definition 12. Ill and Theorem l2.12l 
In particular, we will sometimes skip the obvious step involving the maximum, as 
discussed in the former remark. 

Of course, it is a theorem of constructive mathematics (See e.g. [121 P-47])) that a 
uniformly continuous function (with a modulus) is Riemann integrable on compact 
intervals. What is surpring is that the proof of Theorem 13.31 still goes through in a 
constructive setting, as it seems we used a number of non-constructive logical laws 
in the previous proof, like independence of premises to bring the quantifier ‘(d^^A^')’ 
to the front as in (13.lip . As it turns out, this is not problematic, as we show now. 

Corollary 3.7. Theorem \3.3\ also goes through constructively, i.e. we can prove 
CRIns in H and a term t can be extracted such that E-HA‘^* proves CRIef(f). 

Proof. First of all, it is clear that the proof of CRIns in the theorem also goes through 
in H. We now show that CRIns can be brought into the normal form (|3.28p (which is 
essentially (|3.141) 1 inside the constructive system H. Hence, working in H, consider 
the antecedent of CRIns as in (13.41) . The quantifier (V®*A:) can be brought to the 
front as in (13. 5p in intuitionistic logic, i.e. we obtain 

(V"*fc)(Va:,j/ G [0,l])[(V"‘A)|a;-?/| < ^ ^ \ fix) - f{y)\ < ^]. (3.19) 

To bring the quantifier (V^^A) to the front, we apply the axiom HGMP’’* included 
in H to (I3.19p . which is sufficiently internal, to obtain 

(W‘fc)(Vcr,j/ G [0, l])(3«tA')[(VA < N')\x - y\ < ^ ^ |/(x) - f{y)\ < i], (3.20) 
which immediately yields 

(W‘fc)(Va:, 1 / G [0, l])(3^‘A)[|a: - y\ < ^ \f{x) - f{y)\ < i]. 


(3.21) 
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The system H also includes NCR, which implies the contraposition of idealisation I. 
Hence, applying NCR to (I3.21|l . we obtain 

(V^‘fc)(3^‘iV')(Vx, y e [0, l])(3iV' < iV)[|x - y| < ^ ^ \f{x) - f{y)\ < i], (3.22) 

which again immediately yields 

(V^*fc)(3^‘lV)(Va:,y G [0, l])[|a; - 2/| < ^ ^ \f{x) - f{y)\ < i], (3.23) 

Since HACint is also included in H, we obtain ()3.9p . and (j3.10p is proved similarly 
inside H. So far, we have shown that H proves 

(V/)[(3^*5)(V^‘fc)H(g,fc,/) ^ (y^^k'){3^^N')B{k',N'J)], (3.24) 

which immediately yields (due to intuitionistic logic) that 

(V/)(V^‘g, k%y^^k)A{g, k, f) ^ (3^‘iV')S(fc', iV', /)], (3.25) 

To bring the quantifier (3®*Af') to the front, we apply the axiom HlPys* included in 
H to (I3.25p . which is sufficiently internal, to obtain 

(V/)(V^*5, fc, /) ^ (3iV' < N)B{k', N', /)], (3.26) 

which again yields, due to the monotone behaviour of B, that 

(V/)(V^‘g,A')(3^‘^)[(V^‘fc)^(ff,fc,/) ^ B{k',N,f)]. (3.27) 

To bring the quantifier (V®‘fc) to the front, we apply the axiom HGMP®* included 
in H to (13.271) . which is sufficiently internal, to obtain 

(V^‘5,F)(V/)(3^‘iV,A)[(Vfc" < k)Aig,k",f)^B{k',N,f)], (3.28) 

which is essentially (13.111) . Similar to the way the latter gives rise to p.l4p . apply 

NCR (which supplies the classical contraposition of idealisation I) to (I3.28P to obtain 

(V^*5, fc')(3^'iV)(V/)(3fc)[(Vfc" < fc)H(g, fc", /) ^ i?(fc', fV, /)], (3.29) 

Now apply Theorem 12.121 to (13.291) to obtain CRIef(t) in the same way as in the 
proof of the theorem. □ 

We repeat that it is rather surprising that the system H includes exactly the 
‘non-constructive’ axioms (listed in Definition l2.11l) required to bring nonstandard 
definitions into the associated normal form in a constructive setting. We discuss 
this ‘non-constructive’ status in more detail in the following remark. 

Remark 3.8. First of all, note that the axioms from Definition 12.111 only apply to 
a part of the universe of objects, namely the standard ones. This partiality explains 
why these axioms can be ‘constructive’ at all, in the sense that H and E-HA"^* prove 
the same internal sentences. 

Secondly, Nelson states in [53 p. 1166] that in 1ST, every specific object of con¬ 
ventional mathematics is a standard set. In other words, the universe of standard 
objects may be viewed as an attempt at isolating the ‘actual objects of mathematics’ 
from the formalism in which they are studied. 

Thirdly, Bishop discusses in [13 p. 56] the concept of numerical implication, 
an alternative constructive notion of implication based on Godel’s Dialectica in¬ 
terpretation; He notes that in practice the usual definition of implication amounts 
to numerical implication. Furthermore, Bishop conjectures that numerical implica¬ 
tion can be derived constructively, while his derivation in m uses non-constructive 
principles like independence of premises and Markov’s principle. 
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In light of these three observations, the first two ‘non-constructive’ axioms from 
Definition [2hT] are nothing more than a formalisation of the claims made by Nelson 
and Bishop regarding mathematical practice. 


3.1.3. Herhrandisation. In this section, we introduce the notion of Hebrandisation. 
Intuitively speaking, the latter is a ‘more constructive’ version of CRIef(t) which 
implies CRI^s in Pq. Indeed, the results so far obtained in this section suggest that 
if one shakes Nonstandard Analysis in the right way, constructive mathematics will 
fall out. It is a natural question, especially in the light of RM, if there is a reversal 
here: In particular, is there a way to make Nonstandard Analysis ‘fall out of’ 
some kind of constructive mathematics? We shall provide a positive answer to this 
question in Corollary 13.101 To prove the latter, we first need to consider a slightly 
modified proof of Theorem 13.31 


Remark 3.9 (Herbrandisation). Consider the proof of Theorem 13.31 in particular 
the step from (13.1211 to (13.141) . Instead of ‘forgetting’ the information regarding k 
in (j3.1211 , we apply Corollary 12.51 directly to the formula 13.121 to obtain a term t 
such that E-PRA“* proves (where A, B are as in the proof of Theorem l3.311 : 

(V<7, k'){3l e t{g, k’))(yf){3N', k < l)[A{g, k, f) ^ B{k', N', /)]. 


Now define s{g, k') as the maximum of all entries of t{g, k') and note that 

(V5, /, k') [(Vfc < s{g, k'))A{g, k, f) ^ B{k', s{g, k'), /)]. (3.30) 

It is insightful to write out (13.30|) in full as follows: 


(V/, g, k') (Vfc < s{g, k'))(yx, y € [0, l])(|a: - y| < ^ \f{x) - fiy)\ < i) 

^ (V^,7r' e p([o, i]))(||^||, IK'II < ^ ^ \SM) - SM)\ < ir)] . (3.31) 


We refer to (j3.31|) as the Herbrandisation o/CRI, denoted by CRIher(s). The conse¬ 
quent and antecedent of the latter are connected in such a way that pushing (Vfc') 
into the consequent requires dropping the bound s{g,k') in the antecedent; This 
however break the aforementioned connection. 


We now show that a proof of the Herbrandisation (13.311) can be converted into 
a proof of the nonstandard version CRlns. Combined with Theorem 13.31 and Re- 
mark [531 we observe that CRlps and CRlf,er(t) have the same computational content 
in that a proof of one theorem can be converted into a proof of the other one. 

Corollary 3.10. Let t be a term in the internal language. A proof inside E-PRA“* 
of the Herbrandisation CRl(ier(t), can be converted into a proof inside Pq o/CRlpj. 

Proof. First of all, recall that any term t of the internal language is standard in Pg 
due to Definition l2.21 Hence, if E-PRA"^* proves CRIher(i)i then Pg proves CRIher(t)A 
st(t). Now fix a function /, nonstandard continuous on [0,1], and obtain (13.91) as in 
the proof of the theorem. For g as in (13.91) . we obtain the antecedent of CRlher(t) for 
any standard k'. Hence, we also have the consequent of CRlher(t) for any standard 
k', which immediately yields the nonstandard Riemann integrability of / on [0,1]. 
Note that for both the antecedent and consequent cases it is essential that t maps 
standard inputs to standard outputs. □ 


We now discuss various interpretations of the Herbrandisation CRlher(t). 
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Remark 3.11 (Use principle). The Use principle is a basic result in Computability 
theory (See e.g. [76l Theorem 1.9, p. 50]) which states that for an oracle Turing 
machine which halts, the output only depends on a finite subset of the oracle. In 
other words, such a Turing machine only ‘uses’ a finite subset of its oracle. 

Analogously, the consequent of CRIef(t) as in (II. 2|) also only ‘uses’ finitely many 
instances of the antecedent in the following specific way: Let (Vfc)A(fc, /, g) and 
{'in)B{n, f,g) be the antecedent and consequent of (II. 2|) (with ‘(Vn)’ brought into 
the consequent). Then for fixed no,/o,goj to guarantee that B{nQ, Jq, go), we do 
not require {\/k)A{k, f, g), but only (Vfc < kQ)A{k, f,g) for some fixed /cq (which 
of course depends on ng). The Herbrandisation CRIher(t) does nothing more than 
make this dependence explicit, i.e. we know ‘how much’ of the antecedent is ‘used’ 
by the consequent (in an exact numerical way). 

The ‘quantitative’ nature of the Herbrandisation leads us to the following remark. 

Remark 3.12 (Hard versus soft analysis). Hardy makes a distinction between 
‘hard’ and ‘soft’ analysis in [32j p. 64]. Intuitively speaking, soft (resp. hard) anal¬ 
ysis deals with qualitative (resp. quantitative) information and continuous/infinite 
(resp. discrete/finite) objects. Tao has on numerous occasions discussed the con¬ 
nection between so-called hard and soft analysis ([82l[83]), and how Nonstandard 
Analysis connects the two. 

The Herbrandisation CRIher(t) is quantitative or ‘hard’ in nature, as it states that 
to compute the Riemann integral of / up to precision p via S' 7 r(/), we should use 
a partition tt finer than s{g, k') and / should only have ‘jumps’ (or discontinuities) 
in its graph less than s{g, k'), where g witnesses this partial continuity. 

By combining Theorem 13.31 and Corollary 13.101 we can convert a proof of CRI^s 
into a proof CRIf,er(t) cmd vice versa. The forward conversion can be done via the 
template €3 in Section [331 The reverse conversion (and the associated algorithm) 
can be ‘read off’ from the proof of Corollarv l3.I0l Thus, we observe the first steps 
towards an ‘algorithmic two-way street’ between soft analysis (in the guise of CRIns) 
and hard analysis (in the guise of CRIher(t))- 

Remark 3.13 (Real real analysis). In light of the previous remarks, we can view 
CRIef (t) as a ‘global’ statement (as it requires {\/k)A{k, /, g) to provide any informa¬ 
tion), while CRIher(t) is a ‘pointwise’ statement (as it already provides information 
if (V/c < s{g,k' j)A{k, f,g)). In other words, CRIher(t) even provides information 
about certain discontinuous / : IR —>■ IR. This need not be surprising as the following 
function /g has many ‘jumps’ (or discontinuities), but is nonstandard continuous. 




(M e H). 


otherwise 


In particular, CRIns also provides information about functions which are discon¬ 
tinuous in a certain sense. In this way, the nonstandard version CRIps and the 
Herbrandisation (13.311) play the following important foundational role regarding 
idealising assumptions in physics: 

We cannot be sure that IR —>■ IR-functions originating from measurements in 
physics are continuous (nonstandard or e-S), due to finite measurement precision 
and conceptual limitations (the Planck scale). But how can we then apply the 
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usual theorems from calculus, e.g. involving Riemann integration? In general, how 
can the thoroughly idealised results of mathematics apply to physics, given that we 
cannot verify if the (infinitary) conditions of mathematical theorems are met due 
to finite measurement precision and conceptual limitations? 

The answer to these grand questions seems quite simple in light of the connec¬ 
tion between CRIns and its Herbrandisation: We can just prove results from ‘pure’ 
Nonstandard Analysis like CRIns and obtain the associated Herbrandisation, which 
also provides approximations to the Riemann integral, should the function / be 
discontinuous (or just unknown to be continuous beyond a certain precision). In 
other words, it seems that theorems from pure Nonstandard Analysis are ‘robust’ in 
the sense that their associated Herbrandisations still provide approximate/partial 
results if the conditions of the original theorem are only partially/approximately 
met. In our opinion, this robustness partially explains ‘that other unreasonable 
effectiveness’, namely why mathematics is so effective, as in useful, in the natural 
sciences, as discussed by Wigner in [87]. IronicalljQ, this robustness also constitutes 
a formalisation of the following observation made by Bishop. 

[... ] whenever you have a theorem: R —^ A, then you suspect that 
you have a theorem: B is approximately true —>■ A is approximately 
true, ([m p. 513]) 

In conclusion, the nonstandard version CRIns gives rise to the effective version 
CRIef in an elegant and algorithmic fashion. Conversely, to re-obtain the former, 
the Herbrandisation CRIher is needed, which provides approximate results if the 
conditions in the consequent are only partially met. 

3.2. Uniform limit theorem. In this section, we study the uniform limit theorem 
ULC from [54l Theorem 21.6], which states that if a sequence of continuous functions 
uniformly converges to another function, the latter is also continuous. We will 
obtain the effective version of ULC from the nonstandard version using Pq. We 
adopt the usual definition of nonstandard convergence, namely as follows. 

Definition 3.14. [Nonstandard convergence] 

(1) A sequence nonstandard converges to if {\/N G fl){x ~ xn). 

(2) A sequence nonstandard uniformly converges to on [0,1] if 

(Vxe [0,l],iVGH)(/^(x)«/(:r)). 

Hence, we have the following nonstandard and effective version of ULC. 

Theorem 3.15 (ULCns). For all fmf : R —t R, *//n is nonstandard eontinuous 
on [0,1] for all standard n, and fn nonstandard uniformly converges to f on [0,1], 
then f is also nonstandard continuous on [0,1]. 

Theorem 3.16 (ULCef(t)). For all f{.),g{.),h, and f, if fn is continuous on [0,1] 
with modulus gn for all n, and fn uniformly converges to f on [0,1] with modulus 
h, then f is continuous on [0,1] with modulus t{g(^.),h). 

We have the following theorem. 

Theorem 3.17. From the proof of ULCns in Pg, a term t can he extracted such 
that E-PRA‘^* proves ULCef(t). 


®For the reader to properly appreciate the irony here, 1151 p. 513] should be consulted. 
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Proof. We first show that ULCns can be proved in E-PRA^^*. To this end, let / 
and fn be as in the antecedent of ULCns. Now fix standard xq G [0,1] and any 
yo G [0,1] such that xq « yo- By assumption, we have (V®*n)(/„(a;o) ~ /n(yo)), 
implying (V’'‘n, fc)(|/„(a;o) - fn{yo)\ < i)- By overspill, there is Ng G fl such that 
(Vn,k < No)(lf„(xo) - fn(yo)l < i)- Again by assumption, we have /(xg) ss 
fNoi^o) ~ fNoiVo) ~ /( 2 / 0 )) which implies the nonstandard continuity of /. 


Secondly, we show that ULCns can be brought into the right normal form for 
applying Corollarv l2.5l Making explicit all standard quantifiers in the first conjunct 
in the antecedent of ULCns, we obtain: 

G [0, l],n°)(Vyi G [0, l])[(V"*iV)|a; - ?/| < ^ (V"*fc)|/„(a:) -/„(y)| < i] 

Bringing the standard quantifiers to the front as much possible, this becomes 

G [0, l],n°,fc°)(Vyi G [0, l])(3"*N)[|x - y| < A _ /„(y)| < i]. 

Since the formula in square brackets is internal, we may apply (the contraposition 
of) idealisation I and obtain 

G [0, l],n°,fc°)(3"‘TO°)(Vyi G [0,1])(3/C < TO)[|a;-y| < ^ \ fu{x)-fn{y)\ < i], 

which immediately yields 

G [0,l],n°,A:°)(3"*iV°)(Vyi G [0, l])[|a; - y| < jj ^ \fu{x) -/„(y)| < |]. 

Now apply HACint to obtain a standard functional iIi such that (3A^ G di(a;,n, k)). 
Define gn{x,k) as maxi<|^(a; „ j,)! ^(x,n,k)(i) and we obtain: 

G [0, l],n0,fc0)[(Vyi G [0, l])[|a:-y| < ^ \ fn{x)-fn{y)\ < ;^]]. 

For brevity let A)-) be the formula in big square brackets. Similarly, the second 
conjunct of the antecedent of ULCns yields 

(3‘^t/i)(W‘fc) [(Vx G [0,1])(V7V > h{x, fc))(|/iv(x) - f{x)\ < i)], 

where B{-) is the formula in big square brackets. Lastly, the consequent of ULCps, 
which is just the nonstandard continuity of /, implies 

(y^^k,x£ [0,l])(3"*Af)[(Vy G [0, l])(|ai-y| < ^ ^ \ f{x) - f{y)\ < -^j], 

where E{-) is the formula in big square brackets. Hence ULCns implies that 

(V/, /„) [[(3^‘y(.))(W‘xi G [0, l],n°, fc°)H(/„, y„, x, n, k) A (3^‘/i)(W*fc')i?(/, U,h, k')] 

(W*fc",x' G [0,l]){3^^N)E{f,N,k'',x') 

Bringing all standard quantifiers to the front, we obtain 

(VV),/i,fc",x' G [0,1]) (V/,/„)(3 -*xG [0,l],n°,fc,fc',jV°) 

[Mfn,gn,x,n,k) A B{f,fri,h,k')] ^ E{f,N,k'',x') , 


(3.32) 


where the formula in big(gest) square brackets is internal. Applying idealisation to 
the underlined quantifier alternation in (I3.32|) . we obtain 

(V^‘g(.),A,fc",x' G [0,1])(3 ^‘z)(V/,/„)(3(xG [0,l],n°,fc,A:',iVO) Gz) (3.33) 

[A(/„, 5„, X, n, k) A B{ f, /„, h, k')] E{f, N, k", x') 
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As ()3.33[l was proved in Pq, Corollary 12. 51 tells us that E-PRA"^* 
,x e [0, l])(3z G t{g(.),h,k",x'))(yf, fn){^{.x G [0,1] 
[A{fn, 9 n,x,n,k) ^B{fJrl,h,k')\ E{f,N,k",x') , 


proves 

,n°,k,k',N°) G z) 
(3.34) 


where t is a term in the language of E-PRA”^*. The formula (13.341) yields 

(Vff(.),h, k", x' G [0, l])(3iV° G s( 5 (.), h, k", x'Wf, /„)(3t G [0,1], n°, k, k') 


[Mfn, gn, X, n, k) A B{f, /„, h, fc')] ^ E{f, N, k", x') 


(3.35) 


where s is obtained by ignoring all components of t except those containing the 
potential witnesses to N. Note that the special structure of E plays a role. Now 
dehne u{g(^.),h,k'',x'))) to be the maximum of all components of s{gt^.),h,k",x'))) 
and push all existential quantifiers in (13.3511 back inside the square brackets: 

[(Va; G [0,1],n°,k)A{fn,gn,x,n,k) (3.36) 

A {Vk')B{f, /„, h, k')] ^ (Vfc", x' G [0, l])Eif, w( 5 (.), h, k", x'), k", x') 

which is exactly ULCef(M), and we are done. □ 


(V/,/n,g(.),h) 


As it turns out, there is a constructive version of the uniform limit theorem in 
Constructive Analysis (See [iTl Prop. 1.12, p. 86]), and there is a somewhat similar 
version of the uniform limit theorem in computability theory (See |901 Prop. 3.2]). 

Corollary 3.18. The theorem also goes through constructively, i.e. we can prove 
ULCns in H and a term t can be extracted such that E-HA"^* proves ULCef(t). 

Proof. Similar to the proof of Corollary 13.71 □ 

Following Remark 13.91 the Herbrandisation ULCher(s) is defined as (13.341) . Note 
that once the correct Herbrandisation is found, re-obtaining the original nonstan¬ 
dard version is easy; In particular, the proof of Corollary [STO] amounts to nothing 
more than the observation that the term t in the Herbrandisation CRIher(i) is stan¬ 
dard in Pq, which yields the nonstandard definitions from the usual ones. 

Corollary 3.19. Let t he a term in the internal language. A proof inside E-PRA"^ 
o/ULCher(l), can be converted into a proof inside Pq o/ ULCns. 

Proof. Similar to the proof of Corollarv l3.10l In particular, note that the term t is 
standard in Pq and observe that this yields ULCns from ULCher(l)- □ 

The Herbrandisation ULCf,er(^) tells us ‘how much’ continuity and convergence 
of fn we need to obtain ‘how much’ partial pointwise continuity of /. In particular, 
the term t provides a finite collection of points x G [0,1], precisions k,k' and 
indices n for which /„ should satisfy the corresponding definitions of continuity 
and convergence (to /), to guarantee pointwise continuity of / around x' G [0,1] 
up to precision k" in an interval also determined by t. 

The uniform limit theorem merely serves as an example of the class of theorems 
which can be treated in a similar way as Theorem 13.171 Another more challenging 
example is [53 Theorem 7.17, p. 152] as follows. 
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Theorem 3.20. Suppose fn is a sequence of functions, differentiable on [a,b], and 
fn{xo) converges for some point xo on [a,6]. If f^ converges uniformly on [a,b], then 
fn converges uniformly to a function f, and f'{x) = fh{x) for x € [a, b]. 

Note that we can avoid talking about the existence of / in the nonstandard 
version of Theorem 13 . 201 by instead making use of /at for any nonstandard N. 

In conclusion, the two above case studies (Theorems 13.31 and I3.17P suggest that 
the ‘constructive’ version of a theorem can be derived from the ‘nonstandard’ ver¬ 
sion in a rather algorithmic fashion. The associated template €3 shall be formulated 
in Section [321 Before that, we treat two more case studies, but in less detail than 
the above ones. These two extra case studies are also interesting in their own right. 


3.3. Fundamental theorem of calculus. In this section, we treat the fundamen¬ 
tal theorem of calculus (denoted FTC; See [65l §6]). As is well-known, FTC states 
that differentiability and integration cancel each other out. We will formulate var¬ 
ious nonstandard versions of FTC with proofs in Pq, and obtain the associated 
effective versions. Our study of FTC is interesting in its own right, as it leads to a 
non-trivial extension of the scope of Corollary 12.51 due to Theorem 13.241 


We use the following definition of nonstandard differentiability. 


Definition 3.21. [Nonstandard differentiability] A function / : [R —>■ OR is nonstan¬ 
dard differentiable on [0,1] if for all standard 

(V£,£' Ri 0)(Va; G [--^,1 + i])[£,e' ^eifix)) ss A^ff{x))], 
where A,{f{x)) := 

We now study the part of FTC which states that F'{x) = f{x) for continuous / 
and the primitive F{x) := f{x)dx; The first nonstandard version of FTC is as 
follows, where ST,-{f,0,x) is the Riemann sum corresponding to / and tt limited to 
the interval [0,a;] as in Definition 13.21 

Theorem 3.22 (FTCps). For all f ■. R ^ R and all standard k^, if f is nonstandard 
uniform continuous on [0,1], then 

e [i, l-i])(ViV G D)(V7r G P([0,1])) [\\n\\-N « 0 ^ A,/^ {SM, 0, x)) ^ f{x)]. 

Note that |]7r|j as in the consequent FTCns is not only infinitesimal, but also 
‘infinitesimal compared to 1/A^’. The associated effective version FTCef(t) is: 


Theorem 3.23 (FTCef(t)). For all f : R ^ R with modulus of uniform continuity 
g on [0,1], and any k, we have for all x G [^, 1 — ^] and all I that: 


(ViV>t(5,fc,Z)(l),7rGP([0,l])) |||7r|]W| < 


t(S:fe4)(2) 


|Ai (5^(/,0,x))-/(x) 



In contrast to CRI^s and ULCps from the previous sections, the consequent of 
FTCns does not have an obvious normal form. In this light, we prove the following 
theorem which significantly extends the scope of Corollary [521 


Theorem 3.24 (Pq)- For internal tp, the formula (ViV G Q){\/^^x){3^'^y)ip{x,y, N) 
has an equivalent normal form {as given by (13. 371) 1. 
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Proof. Let ip be internal and consider (ViV G y, N), which yields 

(V^‘x)(VlV)[(V^‘fc°)(iV >k)^ {3^^yMx,y,N)]. 

Pushing the standard quantifiers outside, we obtain 

(V^‘a;)(ViV)(3^‘A:, y)[N > k ^ ip{x, y, TV)], 

and applying idealisation I, a normal form emerges: 

(V®*a;)(3®*ic)(V-/V)(3fc, y € w)[N > k ^ (p{x, y, N)]. 

Let 1° be the maximum of all entries in w pertaining to k, and let v be the subse¬ 
quence of w with all entries pertaining to y. With these definitions: 

0f^x){3^^l°,v)(yN[N >l^{3yG vMx,y,N)], (3.37) 

which expresses that underspill may be applied to formulas like in the theorem. □ 

We are now ready to prove the following theorem. 

Theorem 3.25. From the proof of FTCns in Pq, o, term t ean he extracted such 
that E-PRA*^* proves FTCef(t). 

Proof. A straightforward adaptation of the proof of [68l Theorem 29] yields a proof 
of FTCns in Po- In the consequent of FTCns, resolve both occurrences of ‘ss’, push 
the standard quantifiers outside to obtain a formula as in Theorem l3.24l The latter 
theorem then implies that the consequent of FTCns yields the following normal form: 

{y-H){3-^M,K){Vx G[i,l - i])(VAf > M)(V^ G P([0,1])) (3.38) 

IIIttII • A^I < ^ |A^(5^(/,0,x)) -/(a:)| < j , 

and the rest of the proof is similar to that of Theorem 13.31 or 13.171 □ 

There are obvious corollaries to the theorem similar to Corollarv l3.7l and l3.10l In 
particular, we may obtain a constructive version and a Herbrandisation of FTCns. 
This Herbrandisation is nothing more than FTCef(t) with (f/k') in the antecedent 
replaced by (Vfc' < t{g,k,l){3)) for a modified term t. In particular, this Her¬ 
brandisation tells us that for / continuous up to precision l/t{g,k,l){3) witnessed 
by y, differentiation with quotient ^ cancels out, up to precision 1/1, 

Riemann integration for partitions finer than l/{t{g, k, l){2) x N). 

Secondly, we consider a version of FTCps involving the functional l{f,0,x) from 
Section o Note that FTC^^ could also be made ‘hybrid’ as follows: Introduce 
the usual e-(5-definition of uniform continuity with a standard modulus g (in the 
antecedent), and use [/(/,0,x)](y(fc)) in the consequent. With such a modulus, / 
is automatically nonstandard continuous, i.e. one could use techniques from both 
Constructive and Nonstandard Analysis. 

Theorem 3.26 (FTC^^). For / : IR — >■ IR and if f is nonstandard uniformly 
continuous on [0,1], we have (VN G 0, x G 1 “ 'I]) (-!(/) 0; ^)) ~ f(^)) ■ 

Similar to Theorem 13.251 one obtains the following effective version. 

Theorem 3.27 (FTCgf(t)). For / : [R —> IR with modulus of uniform continuity g on 
[0,1], and any k, (V1)(VA > t{g,k,l),x G [^, 1 - i])[|A^(/(/,0,x)) - f{x)\ < }]. 
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The previous example shows that we can ‘mix and match’ nonstandard dehni- 
tions with effective definitions. 

Finally, the second part of FTC as formulated in |651 Theorem 6.21] can be 
treated similarly: The nonstandard version is as follows. 

Theorem 3.28 (FTCps 2 )- For all f : R ^ R and standard k, if f is nonstandard 
differentiable on [i, 1 - i], then (Ve ^ 0) [e 0 -)> I{As{f{-)),0, 1)) Rs /(I) -/(O)]. 

The following effective version of FTCns 2 is obtained similar to Theorem 13.251 

Theorem 3.29 (FTCef 2 (t)). For / : IR —>■ R with modulus of uniform continuity on 
[0,1], and any k, we have for all I that 

(Ve)(Va:e [i,l-i])[0<H< j^^|A,(/(/,0,a;))-(/(l)-/(0))| <i]. (3.39) 

Note that our notion of nonstandard differentiability from Definition 13.211 gives 
rise to Bishop’s definition m Definition 5.1, p. 44]. This is both true for the 
nonstandard version (using D-CA) and the effective version as in FTCef 2 (t), i.e. a 
modulus of (uniform) differentiability as in (13.391) naturally emerges. 

3.4. Picard’s theorem. In this section, we treat the Picard existence theorem 
(PICA for short; See e.g. m IV.8.4]). As suggested by its name, PICA states 
the existence of a (unique) solution to a certain differential equation of the form 
y' = f{x,y). We will formulate various nonstandard versions of PICA with proofs 
in Pq, and obtain the associated effective versions. We make use of the usual 
definitions of Lipschitz continuity and boundedness as follows. 

{\/x,y,z G [-l,l]){\f{x,y) - f{x,z)\ < \y - z\ A\f{x,y)\ < l). (3.40) 

First of all, we study the ‘usual’ nonstandard version of PICA. To this end, consider 
the sequence (pn in m IV.8.4, Equation (16)] (We could also use (f from [Ml 
Equation (22)]). Intuitively speaking, (j)n{x) is such that (j)M{x) ~ fg f{t,(j)M{t))dt 
for nonstandard M, which gives rise to the following theorem. 

Theorem 3.30 (PICApj). For / : R^ —>■ R nonstandard uniformly continuous on 
[—1,1]^, and as in (13.401) . we have (VAT, L GFt,x G [0, l]){(j)Kix) ~ 4>l{x)) and 

(Vx e [-1,1])(VV, M e D) [f « 0 ^ ^f,Mx) - f{x, cI>m{x))] . (3.41) 

The associated effective version is as follows: 

Theorem 3.31 (PICAef(f)). For any / : (R x R) — >■ R with modulus of uniform 
continuity g on [—1,1] x [—1,1], and such that (I3.40|) . we have 

(Vfc)(Vx e [-1,1],A:,L > t{g){k){3))[\(l)K{x) - (t)L{x)\ < , 

(Vfc)(Va: e [-1,1],7V,M > t{g){k){l))[^ < ^ \A^(j)M{x)-f{x,(fM{x))\ < i]. 

Note that PICAef(t) tells us how fast the sequence (pn converges to the unique 
solution of y' = f{x,y), and how fast the derivative of this solution converges to /. 

Theorem 3.32. From the proof of PICAps in Pq, a term t can be extracted such 
that E-PRA*^* proves PICAef(t). 
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Proof. To prove PICAns, the proof of Peano’s existence theorem in [68l Theorem 31] 
or [36l Theorem 14.1, p. 64] is readily adapted to the case at hand. Alternatively, 
to prove Picard’s theorem in RCAq in [TJ] IV.8.4], Simpson constructs a sequence 
(pn which converges to a solution of y' = f{x,y). It is immediate from the details 
of the RM-proof that (pN (x) « pM ( 2 ;) for any nonstandard V, M and any x in the 
relevant interval if / is as in PICAns. 

The second part of the theorem is straightforward in light of the proofs in the 
previous sections. In particular, one easily obtains a normal form for the consequent 
of PICAns using Theorem 13.241 □ 

Secondly, we consider a weaker nonstandard version of PICA, which will yield 
less computational information, as expected. 

Theorem 3.33 (PICAns). For / : IR^ —>■ R, nonstandard uniformly continuous on 
[—1,1]^ and (|3.40l) . we have {3p){\/x G [—1,1])(W S fl) [A^p{x) ps f{x, p{x))\. 

The associated effective version of PICAns is as follows: 

Theorem 3.34 (PICAgf(t)). For any / : (R x R) — >■ IR with modulus of uniform 
continuity g on [—1,1] x [—1,1] such that (I3.40p . we have 

(yk){3P){'ix e [-1, 1],N> t{g){k)) [I A^(^(a;) - f{x, p{x))\ < i] (3.42) 

In contrast to PICAgf (t), the effective version PICA^f (t) only tells us the existence 
of an approximate solution p to y' = f{x,y), while it computes how precise the 
derivative p' needs to be approximated by A^p{x). We have the following theorem. 

Theorem 3.35. From the proof of PICAns in Pq, a term t can be extracted such 
that E-PRA“* proves PICA;f(f). 

Proof. By Theorem 13.321 it is immediate that Pq proves PICA'^. The rest of the 
proof is now straightforward in light of the previous proofs, if we can provide the 
right normal form for the consequent of PICAns- Now, the latter consequent implies 

{3P:R^ R)(Wtfc)(V7V e C!)(Vx G [-l,l])[\A^p{x) - f{x, P{x))\ < i], 
and applying underspill immediately yields 
(30 : R ^ R)(W*fc)(3«tiC)(ViV > K){Vx G [-1,1]) [|A^0(x) - fix, 0(x))l < i], 
and finally we have the following normal form: 

(W‘fc)(3^*iC)(30)(ViV > iC)(Vx G [-1,1]) [I A^0(x) - fix, 0(x))l < i], (3.43) 

and PICAgf(<) now follows in a straightforward manner. □ 

Applying fl-CA to PICAns, we note that p from PICAns may be assumed to be 
standard. Starting from this stronger version in Theorem 13.351 the normal form 
(I3.43P would involve ‘(3®‘0)’, and the associated effective version would provide a 
witnessing functional for (30) (involving a finite sequence of solutions). Similarly, 
the term t in (O only depends on g and not on f, as the former is standard 
in the normal form (I3.I4|) of CRIps, but no such assumption is made for the lat¬ 
ter. The previous is just the observation that term extraction as in Corollary 12.51 
only provides information about standard quantifiers, while ignoring the internal 
quantifiers. This observation leads us to the following remark. 
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Remark 3.36 (Standard quantifiers). If we wish to exclude objects from being 
inputs or outputs of the term t in Corollary 12.51 we can just drop the ‘st’ in the 
relevant quantifiers in the nonstandard version assuming this omission is at all pos- 
sibl^^. In other words, the standard quantifiers quantify over the ‘computationally 
relevant’ objects. A similar setup is defined by Berger in namely an extension 
of Hey ting arithmetic which sports besides the usual quantifiers, new quantifiers 
for which the quantified object is not computationally used in the proof at hand. 
Apparently, this can improve the efficiency of the associated algorithms. A similar 
interpretation of the standard quantifiers is discussed in [TJ p. 1963] and [3TJ §4]. 

As expected, the proof of both nonstandard versions of PICA can be carried out 
in H and we could obtain a version of Corollaries 13.71 and 13.101 As it turns out, 
Picard’s theorem has a constructive proof, to be found in [531 §4]. 

Finally, we have not used the (even constructively true) fact that the solution 
to Picard’s theorem is unique. The following addition could be made to either 
nonstandard version of PICA: 

(V-0)[(VAf e H)(Va: e [-1, l])[A^V’(a;) ~ /(a:, i/’(a;))] 

^ (Va: e [-1,1])(VM e H)(V'(a:) Rs (j)M{x ))\. 

As a result, the effective version of PICA would be extended with a ‘modulus of 
unicity’: Given a functional witnessing h how fast A±ip{x) —>• f{x, ipix)) as n —>■ oo, 
there is a term s(-, h) witnessing how fast (j)m(x) —>■ ^^{x) as m —>• oo. 

3.5. The template O. In this section, we formulate the template O sketched in 
Section o based on the above case studies. We emphasize that some aspects of 
£3 are inherently vague. Recall the algorithms A and B introduced in Section [5T] 

Template 3.37 (O). The starting point for O is a mathematical theorem T 
formulated in the language of E-PA*^*. 

(i) Replace in T all definitions (convergence, continuity, et cetera) by their well- 
known counterparts from Nonstandard Analysis. For the resulting theorem 
T*, look up the proof (e.g. in [36l[77l|88]) and formulate it inside Pq (or P) 
and H if possible. Otherwise add to the conditions of T* external axioms from 
1ST to guarantee this provability. 

(ii) Bring all nonstandard definitions in T* into the normal form (y^^x){3^^y)ip{x, y). 
This operation usually requires I for Pq, and usually requires the new axioms 
from Definition 12.Ill for H. If necessary, drop ‘st’ in leading existential quan¬ 
tifiers of positively occurring formulas. 

(iii) Starting with the most deeply nested implication, bring 

(V"‘a:o)(3"‘j/o)‘/?o(a:^o,2/o) (V"‘a;i)(3"‘?/i)(^i(a::i,yi), (3.44) 

into the normal form {'i^^x){3^*^y)(p{x,y). In particular, apply HACint to the 
antecedent of (|3.44p and bring to the front all standard quantifiers. The last 
step is trivial in Pq and requires the axioms from Definition 12.111 for H. 

(iv) Apply Corollary [53] (if applicable Theorem 12.121) to the proof of (the normal 
form of) T*. The algorithm A (if applicable B) provides a term t. 

^®For instance, we can replace nonstandard continuity in CRIns by 113.911 . but we cannot drop 
the ‘st’ relating to g in (I3.9I I. as the standardness of g is required to guarantee that f in droll is 
still nonstandard continuous. 













28 


THE UNREASONABLE EFFECTIVENESS OF NONSTANDARD ANALYSIS 


(v) Output the term(s) t and the proof(s) of the effective version. 

The theorems in the above case studies all had proofs inside H or Pq, i.e. the 
final sentence in step ([I| does not apply. In Section lU we shall study theorems for 
which we do have to add external axioms of 1ST to the conditions of the theorem. 
Similarly, the final sentence of step ([n]) does not apply to the above first three case 
studies, but was relevant to Picard’s theorem. 

Finally, there is a tradition of Nonstandard Analysis in RM and related topics 
(See e.g. [5^[751[75I1811I921IM] 1. which provides a source of proofs in (pure) Nonstan¬ 
dard Analysis for €3. To automate the process of applying O, we have initiated 
the implementation of the term extraction algorithm from Corollary 12.51 in Agda, 
which is work in progress at this time ([89]). 

4. Main results II; Reverse Mathematics 241 

In this section, we prove the second batch of results involving representative 
theorems from the four strongest Big Five systems of RM. Thus, we establish the 
vast scope of the template €3 from Section 13.51 as discussed in the introduction. 

In particular, we shall prove certain equivalences between nonstandard theorems 
and fragments of Nelson’s axioms Standard Part and Transfer (See Section l2.1|) . 
By running the (usually very simple) proofs of these nonstandard equivalences 
through £3, we obtain explicilEH equivalences for the Big Five beyond the base 
theory. Hence, it seems the RM of Nonstandard Analysis is ‘simpler’ than classical 
RM, and provides more (relative) computational information. Furthermore, the 
corresponding Herbrandisations provide ‘pointwise’ versions of the aforementioned 
explicit equivalences, where the use of the input is more carefully tracked. Thus, as 
suggested by the section title, nonstandard equivalences provide two kinds of RM- 
equivalences, a ‘global’ one directly inspired by RM, and a ‘pointwise’ one which 
contains more computational information, namely the Herbrandisation. 

Finally, our study of compactness in Section 14.21 is particularly interesting as 
nonstandard compactness gives rise to different normal forms which yield quite dif¬ 
ferent effective results: Respectively, the (re)discovery of totally boundedness (the 
preferred notion of compactness in constructive and computable analysis), and the 
(re)discovery of explicitPJJ RM-equivalences at the level of WKLq. Similarly, our 
(quite simple) notion of nonstandard-separating set will give rise to the ‘construc¬ 
tive’ notion of separating set, for the Stone-Weierstrafi theorem in Section |T4| 

4.1. Monotone convergence theorem. In this section, we study the monotone 
convergence theorem MCT, i.e. the statement that every bounded increasing se- 
guence of reals is convergent, which is equivalent to arithmetical comprehension 
ACAq by |74| III.2.2]. In particular, this study provides a first example that the 
template £3 applies to the third Big Five category, while more general results may 
be found in Section ITBl With some effort, the reader may verify that our results 
do not require full primitive recursion, but that the exponential function suffices, 
as studied in |46| §13], [44], and [8]. 


implication (3$)A(<I>) —> (El'I')iJ('I') is explicit if there is a term t in the language such 
that additionally (V4>)[A(<I>) i3(t(<I>))], i.e. can be explicitly defined in terms of <I>. 
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4.1.1. From nonstandard MCT to explicit MCT. In this section, we prove an equiv¬ 
alence between a nonstandard version of MCT and a fr agment of Transfer. From 
this nonstandard equivalence, we extract an explicilP^ RM equivalence involving 
MCT and arithmetical comprehension. 

Firstly, the nonstandard version of MCT (involving nonstandard convergence) is: 

(V'^*c^.fi)[(Vn°)(c„ < cn+i < 1) ^ (ViV,M e fl)[cM « cjv]] • (MCT,,) 

We could have introduced a ‘st’ in the antecedent of lMCT,,] but Theorem 14 .1 1 would 
not change. Note that by applying il-CA from Theorem l2.10l to the consequent, we 
immediately obtain the (standard) limit of Cn- The effective version MCTef(t) is: 

(Vc^.-(^\fc°)[(Vn°)(c„ < Cn+i < 1) -t (yN,M > t(c(.))(fc))[|cM - cn\ < -I]]- (4.1) 
We require two equivalent l |46l Prop. 3.9]) versions of arithmetical comprehension: 

(3^2) [(V/i)((3n)/(n) = 0 fW)) = 0)], (m^) 

( 3 ^ 2 ) [(v/i)((3n)/(n) = 0 fA ^(/) = O], (3^) 

and also the restriction of Nelson’s axiom Transfer as follows: 

(V^t^i) ^ Q ^ (Vm)/(m) + O]. (RO-TRANS) 

Denote by MU(/i) the formula in square brackets in ( |/i^| ). We have the following 
theorem which establishes the explicit equivalence between (pf) and uniform MCT. 

Theorem 4.1. From the proof of MCT,, -fA fl^-TRANS in Pq, two terms s,u can 
be extracted such that E-PRA"^* proves: 

(V^2) [MU(ai) ^ MCTef (s(/r))] A (Vt^^^) [MCTef (<) ^ MU(M(t))]. (4.2) 

Proof. To establish MCT,, —>■ fl^-TRANS, fix standard such that (V®*n)/(n) = 0 
and define the standard sequence C(.) of reals by Cfc = 0 if (Vf < k)f{i) = 0 
and Ck = ^ otherwise. Clearly, C(.) is increasing and hence nonstandard 

convergent as in MCT,,. However, if {3mo)f{mo -P 1) = 0 and toq is the least 
such number, we have 0 = c^o 9^ Cmo+i ~ 1- Thus, H^-TRANS follows and we 
now prove the other direction. Assume H^-TRANS and define (p{f,M) as 0 if 
(3n < M)f{n) = 0 and 1 otherwise. By assumption, we have 

(W‘/')(ViV,M G D)[(p>(/,M) = ^(/,iV) = 0 GA (3«*n)/(n) = 0]. 

Applying H-CA to (p{f,N) yields (3^)®*. The latter is the functional version of 
ACAo (relative to st) and the usual proof of MCT goes through in ACAq (See 
[TTl 1.9.1]). Hence, we obtain MCT®* and MCT,, follows by applying Hj-TRANS 
to the innermost universal formula in the consequent of MCT®* expressing that Cn 
converges; Indeed, the following formula follows from MCT®*: 

(V®*fc)(3^*m)(V®*fV,M > m)[|cM - cn\ < i], 

and apply Hj’-TRANS to (V®*A^, M > m){- ■ ■ ). We now prove the theorem for the 
implication Hj-TRANS —>■ MCT,, and leave the other one to the reader. The former 
implication is readily converted to: 

(V®*/*)(3®*n)[(3m)/(m) = 0 ^ (3f < n)f{i) = 0] (4.3) 

^ (V®*C(.'^*,fc)(3®*m)[(Vn°)(c„ < c„+i < 1) {'dN,M > to)[|cm -cjvj < -I]]- 
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Let A (resp. B) be the first (resp. second) formula in square brackets in (14.3p . 
Applying HACint to the antecedent of the latter (and performing the usual step 
involving the maximum), we obtain (3®*/x^)(V®‘/^)A(/, /i(/)). Hence, (14.31) becomes 

(yst^o^i^ ^ 0 , f)[A{f, B{c(^.),k, m)], 

and Corollary 12.51 yields a term t such that E-PRA"^* proves 

(Vc^.]^\fc°,/x2)(3TO,/ e t(/i,C(.),fc))[A(/,^(/)) H(c(.),fc,TO)], (4.4) 

and define s{^,C(^.),k) to be the maximum of all entries for m in t{fj,,C(^.),k). We 
immediately obtain, using classical logic, that 

(V/i 2)[(V/1)A(/,M/)) ^ (Vc^.]^Sfc°)i?(c(.),fc,s(/r,C(.),fc))], 

which is exactly as required by the theorem. □ 

With slight effort, the proof of MCTns -fA Hj’-TRANS goes through in H, and 
hence the theorem is constructive. We again stress that the results in (14.21) are 
not (necessarily) surprising in and of themselves. What is surprising is that we 
can ‘algorithmically’ derive these effective results from the quite simple proof of 
n^-TRANS ■fA MCTns, in which no efforts towards effective results are made. 

4.1.2. Herbrandisation. In this section, we formulate the Herbrandisation of the 
equivalence H^-TRANS AA MCTns and obtain the latter equivalence from the former. 

The Herbrandisation MTEher(s,t) is the conjunction of (14.41) and the following: 

(V/^)(3m°,c^.-^\/c°,g^ € s(/)))[H(c(.), fc, 5 (A;)) A(/,m))], (4.5) 

where A, B are as in (lia . Intuitively speaking, (IQ) effectively converts Fefer- 
man’s search operator into a uniform version of MCT (and vice versa), while the 
Herbrandisation MCTf,er(s,t) effectively converts a finite sequence of instances of 
Feferman’s search operator into one instance of MCT (and vice versa). Thus, the 
Herbrandisation of MCTps is the pointwise version of the effective result (1121). 

Corollary 4.2. Let s,t be terms in the internal language. A proof inside E-PRA“* 
o/MTEher(sj i), can be converted into a proof inside Pq o/n)’-TRANS AA MCTns. 

Proof. For the first conjunct of MTEher(s, t), i.e. (14.41) . the term t is standard in Pq, 
yielding that the latter proves 

Ai^)(3^*m, f)[A{f, p{f)) ^ i?(c(.), fc, m)]. 

Bringing all quantifiers inside again, we obtain 

(3^V")(V^V)dl(/,/r(/)) ^ (V^*c^.j^\fc°)(3^‘m°)i?(c(.),fc,m). (4.6) 

The consequent of (14.61) clearly implies MCTns, while the antecedent is equivalent 
to (V®*/)(3®*n)A(/,n) thanks to HACint. Hence, the antecedent of (j4.6l) is clearly 
H^-TRANS. One treats (14.5p in exactly the same way. □ 

By the previous corollary, the equivalence H^-TRANS aa MCTps contains the 
same computational information (up to algorithmic extraction) as its Herbrandis¬ 
ation MCTher(s,f). The latter tells us which instances of the search operator [p?) 
are needed to witness the convergence of a given sequence C(.) up to a given preci¬ 
sion 1/fc, and vice versa. Hence, we can establish a bridge between soft and hard 
analysis even if the theorem at hand is non-constructive thanks to the nonstandard 
version of the RM-equivalence. 
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In conclusion, it turns out we may extract two kind of RM-equivalences from 
MCTps! The ‘global’ equivalence (|4.2I1 and the ‘pointwise’ Herbrandisation, and the 
latter contains much more computational information. In other words, the RM 
of Nonstandard Analysis gives rise to at least two kinds of higher-order RM, as 
suggested by the title of Section |4l 

4.1.3. Some corollaries. In this section, we discuss some corollaries to Theorem 14. 2 1 

Firstly, since MCT states the existence of the limit c of C(.), we shall also obtain 
such a version from MCTns too. Let MCTgf(t) be the following variation of (j4.1ll : 

(Vc^.j"i,/c°)[(VnO)(c„ < c„+i < 1) ^ {yN > t(c(.))(l)(fc))(|cjv - t(c(.))(2)| < i)]. 

Corollary 4.3. From the proof of MCTns CA II^-TRANS in Po, two terms s,u can 
be extracted such that E-PRA"^* proves: 

(yp^) [MU(/r) -A MCT^f (s(ai))] A [MCT^f (<) ^ MU(w(t))]. (4.7) 

Proof. Using IIj’-TRANS and fl-CA, the following variant of dm can be obtained: 

< c„+i < 1) ^ (ViV > m)(|cw - c| < i)]. 

Now apply HACjnt to remove the quantifier, and obtain via II^-TRANS that: 

(V’^*c°^i)(3‘*‘ci,hi)(Vfc)[(Vn°)(c„ < Cn+i < 1) ^ (VA^ > h{c^.),k)){\cN - c\ < i)]. 

The rest of the proof is now similar to that of the theorem. Note that Corollarv l2.5l 
only provides a finite list of witnesses to (3c) and (/x^) has to be used to select the 
right one. On the other hand, out of the finite list of witnesses to (3/i), we just take 
the (pointwise) maximum of all entries, which suffices in light of the ‘monotone’ 
behaviour of the associated variable. □ 

Secondly, we now discuss an alternative proof using standard extensionality of 
the previous corollary. Recall from Remark 12.161 that the axiom of standard exten¬ 
sionality cannot be conservatively added to the systems P and H. 

The following corollary is important, as it shows that we can use the axiom 
standard extensionality for proving normal forms, as this axiom is translated by €3 
to (almost) a triviality. Thus, let MCTgf(t) be MCTgf(t) with the extra assumption 
that t is standard extensional, i.e. we additionally have: 

(V"*c^.'y^\s|’.y"i)[c(.) S(.) t(c(.)) Rioxi i(s(.))]- (4.8) 

Note that n°-TRANS implies standard extensionality (14.8|) for standard t from the 
axiom of extensionality (0. 

Corollary 4.4. From the proof of (3®*(p)MCT'f(tp) ^ n^-TRANS in Pq, a term u 
can be extracted such that E-PRA‘^* proves: 

(V:p)[MCT;f(:p)^MU(zx(:^,S))], (4.9) 

where S is an extensionality functional for ip. 

Proof. First of all, assume (3®*(p)MCTgf((/?) and suppose Illj’-TRANS is false; Let / 
and C(.) be as in the proof of Theorem 14.11 and note that C(.) ~o-).i 0°“’'^, while 
0 = (/5(0°^^)(2) y ip{c(.))(2) = 1. This contradicts standard extensionality for (p 
and we obtain II^-TRANS. 
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Secondly, we bring (14.91) in normal form. In particular, resolving in its 
various incarnations in (I4.8|l yields for all standard that: 

(Vstfc0)(3st^0, ^0) [\ cn - sn \ i(c(.)){l) = %.))(l)At(c(.))(2)fc = t(s(.))(2)(fc)]. 

This formula now easily yields a normal for (y;) n°-TRANS in light 

of the proof of the theorem. Applying O now finishes the proof. □ 

The previous proof is not much shorter than that of Corollary 14.31 but it is con¬ 
ceptually interesting that we may use standard extensionality in obtaining normal 
forms, although we cannot add it as an axiom to our base theory, as discussed in 
Remark 12.161 Furthermore, Kohlenbach studies theorems regarding discontinuous 
functions of type IR ^ R and related domains in [351 §3]- These theorems naturally 
involve functionals of type 1 —>■ 1 and are thus particularly amenable to the above 
‘standard extensionality’ trick. 

It should not come as a surprise that the results obtained in this section for MCT 
can be generalised to other theorems from RM equivalent to ACAq. For instance, in 
light of the proof of [za III.2.8], it is straightforward to obtain Theorem 14.11 and its 
corollaries for the Ascoli-Arzela theorem. For theorems not dealing with analysis, 
we shall even obtain a template in Section iTBl Moreover, in Sections 14.21 and 14.31 
(resp. Section [4.5l) . we shall obtain explicit equivalences for the second (resp. fourth 
and fifth) Big Five system WKLq (resp. ATRq and nJ-CAo). 

4.1.4. Connection to Kohlenbach’s proof mining. We discuss the connection be¬ 
tween our results and Kohlenbach’s proof mining program ([45]). In particular, 
we consider a well-known limitation of the proof mining of classical mathematics 
in Example 14.51 namely the existence of sentences with only two quantiher alter¬ 
nations from which no computational content can be extracted for the existential 
quantiher. We then observe that our nonstandard framework manages to avoid this 
limitation, and discuss the implications of this observation. 

First of all, we consider the following example. 

Example 4.5 (The scope of the proof mining of classical mathematics). We con¬ 
sider a common ‘counterexample’ from the proof mining of classical mathematics 
from [33 §2.2]. To this end, let T be Kleene’s well-known primitive recursive pred¬ 
icate as in e.g. iza Theorem 3.3], where T{x,y,z) intuitively expresses that the 
Turing machine with index x and input y halts with output z. Then the following 
formula has a trivial proof using the law of excluded middle: 

{yx°)i3y°){yz°){T{x,x,y) V -nT{x,x,z)). (4.10) 

As discussed in [33 §2-2], an upper bound for y in (14.101) gives rise to a solution to 
the (non-computable) Halting problem. In other words, (14.101) is a simple example 
of a classically provable formula for which proof mining cannot provide computable 
information about the existential quantifier. In particular, (14.101) suggests that 
the proof mining of classical mathematics is limited to formulas with less than two 
quantiher alternations; By contrast, the template €3 has no such restriction. 


Secondly, in light of the previous example, we are forced to show why (14.101) is 
unproblematic for our nonstandard framework. We proceed as follows: Observe 
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that neither (j4.10l) nor is a normal form, i.e. we cannot apply term extrac¬ 

tion to the fact that P proves the former two formulas. Now, one can prove the 
following formula: 

(V"*a:°)(3"*y°)(Vz°)(r(a:,a:,?/) V -.T(a;, a;, z)), (4.11) 

inside Pod-II^-TRANS, but applying term extraction (as in the previous theorems in 
this section) yields a bound on y in terms of the Turing jump functional. Thus, no 
contradiction with Corollary 12. 51 ensues. Furthermore, (14.111) cannolF^ be proved in 
P, and allowing (standard) oracles in (14.101) . the latter would even imply H^-TRANS. 

Thirdly, in light of Example 14.51 the usual ‘e-(5’ definition of convergence (with 
its two quantifier alternations) cannot be studied directly in the proof mining of 
classical mathematics. To this end, the following (classically equivalent) definition 
of convergence, called ‘metastable’ by Tao ([83l p. 79]), is studied: 

(Vfc0,5i)(3iV0)[(V*0,j0 e [N,N + g{N)])i\x,-Xj\ < i)]. (4.12) 

We now show that the nonstandard version of (|4.12l) has little computational con¬ 
tent, similar to (I4.10p . To this end, let A{k, g, N, X(^.'j) be the formula in square 
brackets in (14.121) and define METAns as the statement that for all standard se¬ 
quences X(.) we have (V®*fc°,g^)(3®*iV°)A(fc,5,iV,X(.)) —>• (3®*Ar°)(Vn°)(|x„| < K). 
We have the following theorem, which sprouts from the section on metastability in 
Diener’s forthcoming Habilitationsschrift ( [24] 1. 

Theorem 4.6. From the proof P h METAns ^ Ilj’-TRANS, a term t can be ex¬ 
tracted such that for any <1>^, /i^, if we have 

(Vfc°,g^)(3Af° < h{k,g))A{k,g,N,X(^.)) (Vn°)(|x„| < $(ti)), 

then MU(t($)), i.e. t computes the Turing jump from any functional $ providing 
an upper bound for a metastable seguence. 

Proof. The implication Il^-TRANS —> METAns is straightforward in light of the 
equivalence between the usual definition of convergence and (14.121) relative to ‘st’; 
llj’-TRANS is then used to make the sequence bounded everywhere. For the reverse 
implication, assume METAps and suppose n^-TRANS is false; Let be standard 
such that (3n°)(/(n) ^ 0) A (V®*m°)(/(m) = 0) and define x„ := X]r=o*/(^)- 
This sequence is standard and metastable as in the antecedent of METAns- By the 
latter, X(.) is bounded by a standard number, but this yields a contradiction as x„n 
is nonstandard if /(uq) ^0. □ 

By the previous theorem, even obtaining an upper bound (let alone a rate of 
convergence) from a metastable sequence is not possible in a computational way. 

Fourth, part of the point of studying METAps and (14.111) as above is to show that 
Nonstandard Analysis cannot ‘magically’ solve the problems in the proof mining 
of classical mathematics. However, by grace of its extended language, the limita¬ 
tions of the proof mining of classical mathematics imposed by (14.101) . namely the 
restriction to less than two quantifier alternations, do not apply to our nonstan¬ 
dard framework. In other words. Nonstandard Analysis avoids these problems by 
‘moving the goalpost’ (adopting a richer language). Of course, the template O 
is limited to normal forms, but all theorems of ‘pure’ Nonstandard Analysis fall 

P proves 114. ni l, then apply CoroIIarv l2.5l and obtain a term which provides an upper bound 
to the existential quantifier in II4.10II . This term solves the Halting problem, a contradiction. 
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into this category, and such theorems may involve arbitrary many quantifier al¬ 
ternations between internal quantifiers. Furthermore, as shown in Section 14.51 the 
template O applies equally well to theorems of IlJ-CAo, i.e. no special modification 
is necessary to study relatively strong RM-systems. 

Finally, a number of people have pressed the author for a direct comparison be¬ 
tween Kohlenbach’s approach to proof mining and the template O. We conjecture 
that the ‘one-size-fits-all’ provided by the template O is very general, and will 
produce terms of acceptabl^^ complexity while requiring little expertise beyond 
knowledge of Nonstandard Analysis. By contrast, Kohlenbach’s approach is more 
tailored to certain classes of proofs, and therefore produces terms of much better 
complexity; As a downside, considerable experise is required to wield the latter. In 
conclusion, the template O and Kohlenbach’s proof mining are complementary, in 
that the former provides a ‘first approximation’ which can be performed by non¬ 
experts, while the latter fleshes out the exact (or even optimal) complexity, but 
requires considerably more expertise to pull off. 

4.2. Compactness. In this section, we study various theorems regarding compact¬ 
ness. We first introduce nonstandard compactness in Section [4.2.11 and discuss its 
various normal forms. We then study a number of theorems regarding nonstandard 
compactness in Sections 14. 2. 21 to 14.2.51 from which we obtain effective versions. We 
obtain explicit equivalences at the level of WKLq and ACAq. In other words, we 
show that the template O applies to the second and third Big Five category. In 
the interest of space, Herbrandisations are only briefly discussed in Section 14. 3. II 

4.2.1. Nonstandard compactness and normal forms. In this section, we introduce 
nonstandard compactness and discuss its various normal forms. 

First of all, the nonstandard characterisation of compactness is known as Robin¬ 
son’s theorem (See [351 Theorem 2.2, p. 120] or [551 Theorem 4.1.13, p. 93]). In 
particular, a set X is nonstandard compact if (Vx € A)(3®*j/ G X){x ss y), recalling 
Definition 12.151 As it turns out, there are various interesting but different normal 
forms which can be derived from nonstandard compactness, as sketched now. 

Secondly, as an example of an equivalent normal form, consider the nonstandard 
compactness of Cantor space as follows: 

(Va^ <1 l)(3’^‘/3i <1 l)(a /3), (STP) 

which is equivalent to the following formula by [69l Theorem 3.2]: 

(VT^ <1 1) [(V’^‘n)(3/3°)(1/31 = n A /3 e T) ^ (3"*ai <i l)(V’^*n°)(an e T)] (4.13) 

where ‘T <i 1’ denotes that T is a binary tree. Clearly, (14.1311 is a nonstandard ver¬ 
sion of weak Konig’s lemma, and the latter is a compactness principle as discussed 
in [741 IV]. Furthermore, (14.131) is equivalent to the following normal form: 

^0) g yj)[{ag{^a)^T) (4.14) 

^(V/3<i 1)(3* < A)(^i^T)] 

^^One heuristic in proof ming is that short proofs yield terms of low complexity, as each step in 
the proof determines a sub-term of the eventually extracted term. Now, Nonstandard Analysis is 
known for its short proofs, while the term t from Corollarv l2.5l onlv depends on the use of external 
axioms; In particular, internal axioms like the usual induction axiom of or E-PA^^*, do 

not influence the complexity of the term t (See [71 p. 1981, item 2]). 
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and the latter yields (after term extraction) a ‘special case’ of the fan functional 
(See [69l Cor. 3.4]). Similarly, the nonstandard compactness of the unit interval 
(Vcc G [0,1])(3®‘?/ G [0, l])(cc ss y) is equivalent to a nonstandard version of Heine- 
Borel compactness, namely (I4.30|) . As studied in Section [4.2.41 the latter normal 
form give rise to the explicit versions of certain equivalences from the RM of WKLq. 

Thirdly, we shall also obtain an interesting normal form in Theorem 14.71 which 
is a weakening of nonstandard compactness, as follows: 

G A)(3^ < |/i(fc)|)(|a: - h{k){i)\x < i). (4.15) 

Intuitively speaking, the weaker normal form (14.151) no longer states that every ob¬ 
ject in the space has a standard object infinitely close by, but only the existence of 
a ‘discrete grid’ with infinitesimal mesh on the space. This grid can be obtained by 
fixing standard h as in (|4.15l) and applying overspill. As studied in Sections 14.2.21 
and l4.2.,^ the constructive/computable notion of compactness, called totally bound¬ 
edness, is obtained by term extraction from the weaker normal form (I4.15|) . This 
term extraction result is particularly elegant, as ‘dividing a compact space in infin¬ 
itesimal pieces’ features prominently in the intuitive infinitesimal calculus used to 
date in physics and engineering. 

Finally, similar to the equivalence between STP and ()4.13l) . it can be shown that 
the nonstandard compactness of X is equivalent to the following formula: 

(Vz G Z) [(V^‘n)(3x G X){\x - z\z < i) ^ {3^^y G X){\y - z\z ^ 0)], (4.16) 

where X C Z, and the latter is a metric space with metric \ ■ \z- Note that (14.161) 
expresses sequential compactness, as the antecedent gives rise to a sequence in X 
converging to z; Furthermore, it is straightforward to formulate (I4.16|) for general 
topological spaces (without a metric), i.e. we could treat rather general spaces using 
(14.161) and ()4.17l) . A normal form of (14.161) is similar to the one for (14.131) given by 
(14.141) . namely as follows (and is obtained as in the proof of [69l Cor. 3.4]): 

(Vz G ^)[(Vj/ G w)(l?/ -zj^ >K ^) (4.17) 

^ (Wx G A)(|a; - zjz >ir i)] , 

where, as in Notation o we write z G X* for z = (zq, ... , Zfc) for a sequence of 
length jzj = fc with z^ G A for z < jzj. The normal form (14.171) constitutes an 
‘external’ (as in ‘from the outside’) characterisation of nonstandard compactness: 
A point z G Z is (standardly) bounded away from X ii g bounds all points in the 
grid w G X* away from z. 

4.2.2. Compaetness and continuity I. In this section, we study the statement CSU 
that a eontinuous function on a compact metric space has a supremum. As we will 
observe, applying O to a suitable nonstandard version of CSU, nonstandard com¬ 
pactness is converted to totally boundedness, the preferred notion of compactness 
in constructive and computable mathematics. 

As discussed in Section 14.2.11 nonstandard compactness can be weakened to an 
interesting normal form, which is provided by the following theorem. 

Theorem 4.7 (Pq)- If X is a nonstandard compact metric space, i.e. {\/x G 
A)(3®*?/ G X){x Ri y), then X is ‘effectively compact’ as follows: 

{3’’^h){y^^k){yx G x)(3i < \h{k)\){\x - /i(fc)(z)ix < i), 


(V"‘g)(3"‘w G A*)(3"*n0) 


(4.18) 
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which also implies the following 

(3«Vo)(VM e n)i\/x e X)(3z < \MM)\)ix « MM){i)). (4.19) 

Proof. From (Vx G X)(3®*j/ G X){x y), we obtain 

(y^^k){yx G X){3^^y G X){\x - y\x < i) (4.20) 

and hence (V®‘A:)(3®*?/' G X*)(Va; G X)(3y G y'){\x—y\ < j:) by idealisation I. Apply 
HACint and let $ be the resulting standard functional. Define S(A:) := $(fc)(0) * 
4)(/c)(l) * • • • * <i)(/c)(|$(fc)| — 1) and 'ifo{k) := S(l) S(2) * • ■ • * S(fc). We obtain that 

(V^‘A:)(Vx G A)(3* < \Mk)\)[\x - Mkm\x < i], (4.21) 

and (|4.18p is immediate. The latter implies (I4.19P as follows: Fix a: G X in (14.211) 
and apply overspill to (V®*fc)(3i < |i/)o(fc)|)(|2; — ipo{k){i)\x < -I)- Hence, we obtain 
(3i < |■^/)o(fc)|)(|a: — •4>o{k){i)\x < \) for k < Kq £ which immediately yields 
(Va: G X)(3i < \tpo{Ko)\){x ~ ipoik){i)). Redefining tpo as i/'o slightly, we can 
guarantee that (ViF G f2)(Va; G X)(3i < |^Q(Ar)|)(a: ~ ij)Q{K){i)). Indeed, define 
tpo{M) as fjolKi), where Ki is the largest Kq < M such that (Vfc < Aro)(3i < 
\Mk)\){[\x - ipo{k){i)\x]{M) < i). □ 

Note that (I4.18|) and (14.191) constitute a weakening of nonstandard compactness, 
as there is no longer a standard object infinitesimally close in the former. This 
seems to be the price we have to pay in exchange for the ‘effective content’ present 
in the former. 

The bigger picture regarding (14.191) is as follows: Essential to both nonstandard 
Riemann integration and the nonstandard definition of the supremum as in (13.181) 
(and the whole of the infinitesimal calculus), is the fact that we can ‘divide the unit 
interval in pieces of infinitesimal length’. Intuitively speaking, the functional V'o 
from Theorem 14.71 allows us to perform a similar ‘subdivision’ of any nonstandard 
compact space, as ipo{i) for i < M G D comes infinitely close to any point of the 
nonstandard compact space. 

In light of the previous, let ipo be as in Theorem 14.71 and consider the following: 

supx(/,'*/'o, AI) := max,<M[/(V’o(Af)(z))](M), 

to be compared to (13.181) . The nonstandard version of CSU, is then as follows. In 
light of IZII .10.3], the pointwise case cannot be proved without the use of WKLq, 
explaining why we opted for uniform continuity. 

Theorem 4.8 (CSUps). Let the metric space X be nonstandard compact and let 
f : X ^ R be nonstandard uniformly continuous. Then we have 

fix G X,M G D)[/(a:) ^ sup^(/, , Af)] 

Note that we still obtain the consequent of CSU ns if we replace nonstandard 
compactness in the latter by (14.191) itself. This observation turns out to be essential 
to the proof of Theorem 14.101 The effective version of CSU is: 

Theorem 4.9 (CSUef(t)). For all f : X ^ R with modulus of uniform continuity 
g, and any : 0 —> X* such that: 

{ik,x G X)(3z < \hik)\){\x - h{k)ii)\x < i)] (4.22) 

we have (Vn, x' G [0,1], X > t{g, h, n)(l)) [f{x') < supxif, tig, h, n)(2), X) + i]. 
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Note that a ‘supremum functional’ is readily defined from CSUef(t). Also note 
that the term t only depends on how X is represented by h as in (I4.22I1 . 

Theorem 4.10. From the proof of CSUps in Pq, a term t can be extracted such 
that E-PRA*^* proves CSUef(t). 

Proof. The proof of CSUps is straightforward in light of (j4.19|) . Indeed, the latter 
and nonstandard uniform continuity guarantee that all f{x) are at most infinites¬ 
imally larger than the supremum from CSUns- Note again that we did not use 
nonstandard compactness, but that (14.191) suffices. 

For the second part of the theorem, (Vx € X)(3®*y € X){x ss y) implies 

€ A*)(Vx e X)i3y € y'){\x - y\ < ^ 

as in the proof of Theorem 14.71 Using HACint, it is now immediate that 

(3«t/i)(V^‘fc)(Vx e A)(3* < |/i(fc)|)(|x - h(k){f)\x < i), (4.23) 

which implies (14.1911 in the same way as in Theorem 14.71 As noted in this proof 
and just below CSUns, we can replace nonstandard compactness in CSUns by (14.2311 
and obtain that for / which is nonstandard uniformly continuous on A, we have 

(3’’‘/i)(V«*fc)(Vx e X){3i < \h{km\x - h{k){i)\x < i)] (4.24) 

(Vx e A,M e ll)[/(x) ^ supx(/,i/'o, Af)], 

as 'tpo can also be obtained from (14.231) by Theorem 14.71 Moreover, in light of the 
proof of Theorem 14.71 there is a term s such that for all standard h and / which is 
nonstandard uniformly continuous on X, we have 

(V’^‘/c)(Vx G X){3i < |A(fc)|)(|x - h{k){i)\x < i)] (4.25) 

(Vx G A, M G ll)[/(x) ^ supjf (/, s{h), M)]. 

The rest of the proof is now a straightforward application of O. □ 

It is important to note that the proof hinges on the fact that nonstandard com¬ 
pactness can be replaced in CSUns by (14.2311 to obtain (I4.24|l and (j4.25|l . We discuss 
this observation in the following remark. 

Remark 4.11 (Multiple normal forms). In the theorems in the previous sections, 
the conversion of a nonstandard definition to the ‘effective version’ (of continuity, 
Riemann integration, et cetera) was such that the latter still implied the former. 
As an example, consider nonstandard continuity as in (13.2p which gives rise to the 
normal form (j3.8p and the effective version dSH), and the latter two still imply 
the former. However, as noted right below Theorem 14.71 (j4.19p does not seem to 
imply nonstandard compactness. Nonetheless, (14.2311 does imply (j4.I9l) . and the 
latter suffices for the consequent of CSUns, i-e. we still obtain (14.241) and (14.251) . By 
contrast, it seems the results in [69l §4.1] and Section 14.3.1 1 cannot be obtained with 
anything weaker than the nonstandard compactness of Cantor space as in (14.1311 . 

Furthermore, as above, it is straightforward to prove a version of the previous 
theorem inside H, i.e. the associated results also hold constructiveljQ- On a related 

^^Note that we could apply NCR to the definition of nonstandard compactness (V* € S 

X){x ~ y) directly without removing but our conservation results will not apply due to the 
presence of the latter. Hence, we also apply NCR to 114.2011 in the constructive case. 
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note, consider the condition (|4.22|1 which originates naturally from nonstandard 
compactness. The non-uniform version of (14.221) is: 

(Vfc)(3(aii,. ..Xn)& X*){\/x e X){3i < n){\x - Xi\x < j), (4.26) 

which is nothing more than the notion of totally boundedness, the preferred notion of 
compactness in constructive mathematics (See [171 §4] or [191 §2-2] for a discussion) 
and computable analysis (See [6l §4]). Thus, CSUef(t) is essentially [13 Cor. 4.3, 
p. 94] with the BHK-interpretation of constructive mathematics (See e.g. [HI p. 8]) 
made explicit. Furthermore, our effective version (14.181) corresponds to the notion 
of effectively totally bounded (and the associated compactness) from Computability 
theory (See e.g. [90l Def. 3.1] or [53l Def. 2.6]). As it turns out, both the effective 
(14.221) and non-effective version (|4.26|) are studied in computable analysis, as is clear 
from [HI Theorem 4.10]. 

In conclusion, the constructive and computable notion of compactness totally 
boundedness is implicit in nonstandard compactness, and we rediscover the former 
from the latter by studying CSU using the template €3. However, since we used the 
weakening (14.181) of nonstandard compactness, a Hebrandisation of CSUns cannot 
be obtained using totally boundedness (See also Section 11.3.II) . 

4.2.3. Compactness and continuity II. In this section, we study another theorem 
regarding nonstandard compactness, namely the statement CCI that for a contin¬ 
uous function f from a compact metric space X to a metric space Y, f{X) = {y : 
(3x S X){f{x) = y)} is compact (See [M] 26.5] or [53 4.14]). As in Section 11.2.21 
we obtain totally boundedness from nonstandard compactness by applying €3. 

First of all, with regard to notation, while the set f{X) may not be defined in 
Po, the formula y G f{X) = {3x)f{x) =y y makes perfect sense for any f : X ^ 
Y. Also, (uniform) nonstandard continuity on a metric space X is defined as in 
Definition 13.11 with ‘[0,1]’ replaced by X (Recall the sixth item of Notation l2.15l) . 

Secondly, the nonstandard and effective versions of CCI are as follows. 

Theorem 4.12 (CCIps)- For nonstandard uniformly continuous f : X ^Y: 

{Wx G A)(3^‘:r' G X){x ^ x') ^ (Vy G f{X)){3^^y^ G f{X)){y « y') (4.27) 

Theorem 4.13 (CCIef(t)). For any f : X ^Y with modulus of uniform continuity 
g, and any /i : 0 —)• X*, we have 

{Wk,x G X){3i < \h{k'M\x - h{k'){i)\x < i) 

(Vfc',?/ G f{X)){3i < \t{g,h){l)\){\y-t{g,h)ik'){i)\Y < p). 

Theorem 4.14. From the proof of CChs in Pq, a term t can be extracted such that 
E-PRA*^* proves CCIef(t). 

Proof. The proof of CCIns is a straightforward combination of nonstandard compact¬ 
ness and continuity (See |361 10.11]). For the second part, we replace nonstandard 
compactness in the consequent of CChs by the following version of (14.181) . 

{y^H){3^^w G (/(X))*)(Vy G f{X)){3i < liuDdy - w { i)\y < j). (4.28) 

This replacement is trivial by Theorem 14.71 In the resulting formula, replace the 
nonstandard compactness in the antecedent by the following version of (14.281) : 

(V^*fc)(3«*2 G A*)(Vx G X){3i < \z\)i\x - z{i)\x < i). 


(4.29) 
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This replacement is not trivial, but nevertheless correct in Pq, as nonstandard 
uniform continuity (1321) implies ‘effective’ uniform continuity as in dSS]). The 
version of CCIps obtained by the replacements (14.281) and (j4.29l) now readily gives 
rise to CCIef(t) using O. □ 

As in the previous section, nonstandard compactness gives rise to totally bound¬ 
edness in a natural way. As perhaps expected, CCIef (<) is a theorem of Constructive 
Analysis, namely [ig Prop. 2.2.6]. 

Finally, the Herbrandisation of CCIps can be obtained by using (14.171) for the 
two occurrences of nonstandard compactness in (14.2711 . rather than weakening the 
latter as in the previous proof. A special case will be discussed in Section 14.3.11 

4.2.4. Compactness and continuity III. In this section, we study Heine’s theorem, 
i.e. the statement that a continuous function is uniformly continuous on a compact 
set. To this end, we formulate an equivalent normal form for the nonstandard 
compactness of the unit interval, which turns out to be quite similar to Heine-Borel 
compactness. As a result of applying €3, we obtain an explicit equivalence between 
Heine’s theorem and (the contraposition of) weak Konig’s lemma. 

First of all, we formulate a normal form of the nonstandard compactness of [0,1]. 
Principle 4.15 (HBLns). For every sequence of open intervals {cn,dn), we have 
G [0, l])(3®*n)(c„ x dn) (4.30) 

^ (3’*‘fc)(\f*y G [0, l])(3i < k){c, « y < d,). 

Theorem 4.16. In Pq, we have STP ga (Vx G [0,1])(3®*2/ G [0,1]) GA HBLns. This 
remains valid if we drop the ‘st ’ in the final universal quantifier of HBLps. 

Proof. First of all, assume (|4.30|) and suppose that [0,1] is not nonstandard com¬ 
pact, i.e. (3xo G [0, 1 ])(V®* 2 / G [0, 1 ])( 2 / 76 xq). Then let xq be such a number and let 
Pi be a standard enumeration of all rationals in [0,1]. Define/(i) as |[xo](A^)—( 7 i |/2 
for fixed infinite A^°. By assumption, we have f{i) ^ 0 for standard i. Now con¬ 
sider the sequence {qt — f(i),qi 3- /(*)) and note that we have the antecedent of 
(14.301) . i.e. this sequence standardly covers the unit interval. By the consequent of 
(I4.30|) . there is finite fcg such that Ui<feo(qi — f{i),qi + /(*)) standardly covers the 
unit interval. Now fix M G H and define (resp. as the largest q^ < [xo]{M) 
(resp. smallest largest q^ > [xo](M)) for i < feg- By the definition of /, we have 

dio < dio + /(*o) < xo < qq - f{ii) < qq. 

However, then there are standard rationals between q^p -|- /(*o) and qi.^ — /(*i) 
which are not covered by Ui<feo (q^ — /(*), qi -!-/(*)), a contradiction. Hence, we may 
conclude that [ 0 , 1 ] is nonstandard compact. 

Secondly, assume that [0,1] is nonstandard compact and suppose (14.301) is false, 
i.e. for some sequence we have the antecedent of the latter, but: 

(\f*fc)(3^‘y G [0, l])(Vz < fc)(c, ^ 2 / V q > d,), 
which immediately implies for any infinite M that: 

(V’^tfc)(3^‘q G [0,1])(V* < fc)([c.](M) >0 [y]{M) - i V [y](M) >0 [d.](M) - i). 
Now apply HACint to obtain standard $ such that 

(V^‘fc)(3q G $(fc))(Vz < k){y G [0,1]A[cJ(M) >0 [q](M)-iv[q](M) >0 [d.](M)-i). 
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Now apply overspill to the previous formula, i.e. there is nonstandard such that 
(Vfc < K){3y G $(fc))(Vi < k){y G [0, 1]A[c,](M) >o [y](M)-iv[y](M) >o [d.](M)-i). 

Thus, letyo be such that (Vi < K){yo G [0, 1] A[ci](M) >o [yQ\{M) - [yQ]{M) >o 

[di]{M) — and let standard Xq G [0,1] be such that xq « yo- Combining these 
two facts, we observe that Xo G [0,1] is a standard real such that (V®*i)(ci ^ 
xo V xo ^ di), a contradiction. Hence, (I4.30|) follows and the equivalence from the 
theorem has been proved. 

Thirdly, we show that (I4.30|l generalises as in the last sentence of the theorem. 

To this end, assume (14.3011 for some sequence of opens (cn,d„), let ko be as in the 
consequent of (I4.30I1 . and suppose there is y G [0,1] such that (Vi < fco)(cz ~ 2 /Vy ^ 
di). In the previous formula, we cannot have y ^ Ci oi y ~ di] Indeed, the numbers 
Ci^di for i < ko have a standard part by nonstandard compactness (which follows 
from (I4.30p as proved in the previous paragraph of this proof) and such Ci,di are 
standardly covered by Ui<fc(, (c^, di). Hence, we have (Vi < ko){ci ^ y V y ^ di). 
Now let jo be such that for all j < ko with [cj]{M) — [y]{M) >o 0, the number 
[cjg]{M) — [y](M) is minimal (where M G H is hxed). Similarly, let ji be such that 
for all j < ko with [dj]{M) — [y]{M) <o 0, the number [y]{M) — [dj^]{M) is minimal. 
Again by standard compactness, we may assume and Cj„ to be standard reals, 
and hence covered by Ui<ko{ci, di). This implies 

[cjoKM) - Cj„ < y < dj, ^ [dj,]{M), 

i.e. there are standard numbers not covered by Ui<feo(ci, di) between Cj„ and dj^, a 
contradiction. Hence, the equivalence from the theorem remains valid if we drop 
the ‘st’ in the hnal universal quantifier of (14.3011 . 

Finally, for the equivalence involving STP, every real has a binary representation 
by [33l Cor. 4]. Hence, for every real x G [0,1], there is <i 1 such that x =\r 
Sfci ^PPly STP to find standard <i 1 such that a /3 and note that 
X m y for the standard real y := Hence, STP implies the nonstandard 

compactness of [0,1], and the reverse implication is proved in the same way. □ 

Note that (14.3011 deals with arbitrary covers, not just standard ones. Although 
(14.301) involves a number of standard quantifiers, it does have a straightforward 
normal form, as will become clear in the proof of Theorem l4.I91 The generalisation 
of the previous theorem to general metric spaces is straightforward (See also [lH 
IV.1.5]), but we do not go into details. 

The nonstandard and effective versions of Heine’s theorem are as follows. 


Theorem 4.17 (HEIns). For any / : IR — ^ R, if f is nonstandard continuous on 
[0,1], then it is uniform nonstandard continuous there. 

Theorem 4.18 (HEIef(t)). For /, y : IR —>■ R, if g is a modulus of continuity for f 
on [0,1], then t{g) is a modulus of uniform continuity for f on [0,1]. 


The effective version of Heine-Borel compactness is as follows: 
(V 3 ^C(.),d(.))[(Va: G [0, l])(3n,fc < y(a:))[c„ + i < a; < d„ - i] 


(HBLef(d)) 


(Vy G [0,l])(3i,y < h{g){ci + j < y < di - i) 


The reader might wonder ‘how constructive’ HBLef(h) is; This shall be discussed in 
detail in Remark 14.321 We first prove the following theorem. 
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Theorem 4.19. From the proof of HEIns in Pq + STP, a term t can he extracted 
such that E-PRA“* proves (V/i)[HBLef(/i) ^ HEIef(t(/i))]. 

Proof. The proof P h STP —>■ HEIns follows immediately from Theorem 14.161 By 
the latter, the implication also remains valid if we replace nonstandard compactness 
by Heine-Borel compactness HBLps. We now bring (14.301) in the required normal 
form. First of all, the antecedent of (14.301) yields 

e [0, l]){B^^n,k)[cn + I < X < dn - 1], (4.31) 

to which we may apply HACint to obtain standard g such that 

e [0,l])(3n, fc <o g{x))[cn + ^ < x < - i], (4.32) 

Secondly, the consequent of (14.301) (in its general form) yields 

(3^*fc)(Vy e [0, l])(3^‘0(3^ < k){c, + } < y < d. - j), 

and applying idealisation I, we obtain 

(3'^tfc)(3«t„) [(Vy e [0, 1]){31 < n){3i < fc)(c, + j < y < d, - j)], (4.33) 

which also has the right syntactial form. Finally, let A(x, n, k) be the formula in 
square brackets in (14.311) and let B{k, n) be the formula in square brackets in (14.331) . 
Then (14.301) is equivalent to 

(V®‘y)(3®*x, k\ n') [(3n, k G g{x))A{x, n, k) —>• B{k', n')]. (4.34) 

Now prefix (14.341) by the usual (Vc(.), d(.))-quantifier and apply idealisation I one 
more time to pull the standard extensional quantifier through the former quantifier. 
Thus, we obtain a normal form for (14.301) as follows: 

(V^‘y)(3^‘zi*) [(Vc(.), d(.))(3x, fc', n' e z)C(y, x, fc', n')], (4.35) 

where C is the formula in square brackets in (14.341) . The normal form of nonstan¬ 
dard pointwise continuity is: 

(V^‘x' G [0,l],fc)(3^*lV)[(Vy G [0,l],fc)(|x'-y| < ^ ^ \f{F)-f{y)\ < i)], (4.36) 

which gives rise to the following after applying HACint: 

(3"*/i)(V"*x' G [0,l],fc)(Vy G [0, l],fc)(|x'-y| < |/(x')-/(y)| < ^). (4.37) 

Now let D{g,z) be the formula in square brackets in (14.351) . let E{f,k,N) be the 
formula in square brackets in (13.201) . and let F{ f, x, fc, N) be the formula in square 
brackets in (14.361) : STP HEIns implies that for / : OR ^ R and standard S, 

(y^^x',l)Fif,x',l,h{x',l)) A (y^g)D{g,Eig)) ^ (V^‘fc°)(3^‘lV°)F;(/, d, iV) (4.38) 

The previous formula has almost the right form to apply O, but we need to make 
slight modifications still. First of all, we may trivially drop the ‘st’ on the quantifier 
involving x' for F in (14.381) : This stronger antecedent implies that for fixed ko, the 
cover (y — q + jg^ggpj) for rational covers all reals in the unit interval, 

not just the standard ones. 

Secondly, we do not need (I4.34p to obtain a finite sub-cover of the aforementioned 
cover of [0,1], but it suffices to have the weakening of (I4.34|) by dropping the ‘st’ 
in the quantifier pertaining to x. Now repeat the above steps to obtain (14.381) 
with these modifications (In particular, drop the ‘st’ predicate for x in (14.341) and 
x' in (14.371) 1 in place. This amounts to replacing {3x,k',n' G z) in (14.351) by 
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(3fc',n' € z)(3a;). The theorem now follows from applying O to the version of 
(14.3811 resulting from the aforementioned modifications. □ 

In the previous proof, we applied O to a slight modification of HBLns HEhs. 
In Section 14.3.11 we discuss what happens if no such modification is made by con¬ 
sidering the Herbrandisation of STP. 

Corollary 4.20. From the proof o/STP in Pq -I- HEIns, a term s can be extracted 
such that E-PRA"^* proves (V( 7 )[HEIef(( 7 ) —>■ HBLef(s(g))]. 

Proof. In a nutshell, one simply repeats the proof of the theorem, but for: 

[(V/ : R ^ R)((I33D ^ (133))] ^ (Vx G [0,1])(3^V e [0, l])(ai « y). (4.39) 

To prove the implication (14.391) . suppose there is Xg G [0,1] such that (V®‘j/ G 
[0,l])(xo 9^ y). Fix nonstandard N and define /o(x) := ,- i . Note that 

fo{y) ~ \ xo-y\ standard y, and therefore fo satisfies (|3.1I) . but clearly not (13.2L 
as uniform nonstandard continuity fails for any z pe xq. □ 

Now, the contraposition of weak Kdnig’s lemma is called the fan theorem and 
denoted FAN. Recall that STP is a nonstandard version of weak Konig’s lemma 
in light of (|4.13l) . The contraposition of the latter may be called FAN ns, while the 
effective version is defined as follows: 

(VTi <1 l,y2)[(Va <i l){ag{a) ^T) ^ (V/3 <i l)(^h(y, T) ^ T)] (FANef(h)) 

Hence, the following corollary is proved in the same way as above. 

Corollary 4.21. From the proof Pq h STP -G> HEIps, terms s, t can be extracted such 
thatE-PRA‘^* proves (Vy)[FANef(5) ^ HEIef(s(y))] and (Vh)[HEIef (A) ^ FANef(s(/i))] 

An implication (3$)A($) —>■ (34')H(4') is explicit if there is a term t in the 
language such that additionally (V$)[A($) —)• i?(<($))], i.e. can be explicitly 
defined in terms of $. Hence, we have established the effective equivalence between 
Heine-Borel compactness (3/i)HBLef (A), the fan theorem (3fc)FANef (fc), and Heine’s 
theorem (3y)HEIef(y). The non-effective equivalence between these theorems is 
well-known from RM (See [74l IV.2.3]). Now, the original RM-theorems imply the 
effective versions, given a weak version of the axiom of choice. 

Theorem 4.22. In RCAq + QF-AC^’^, we have FAN —(3/i)FANef(A). 

Proof. By introducing a witnessing functional in the antecedent of FAN, we obtain: 

(VTi <1 I,y2)[(Va <i l){ag{a) ^T) ^ {3k°){y/3 <i l)(^k^T)], 

while the consequent may be trivially weakened as follows: 

(VTi <1 l,y2)[(Va <i l){ag{a) ^T) ^ (3fc°)(V/3°* < 0 - 1)(|/3| = k^pk^T)], 

and bringing outside all unbounded quantifiers, we obtain: 

(Vri <1 l,y2)(3ai <1 l,fc°)[(a 5 (a) ^T)^(V/3°* <o* 1)(|/3| = A: ^ ^ T)], 

and applying QF-AC^’^ to the previous, we obtain (3h)FANef(A). □ 












THE UNREASONABLE EFFECTIVENESS OF NONSTANDARD ANALYSIS 


43 


In conclusion, we have obtained explicit versions of certain equivalences from 
the RM of WKLq. Intuitively sneaking ^1. similar results for other such equivalences 
to WKLq are immediate, provided the theorems involved have the same syntactic 
structure as FAN. As an example of the latter, but also of independent interest, we 
shall study Dini ’s theorem in Section 14.31 On the other hand, theorems equivalent 
to WKLq (classically and constructively) which have a syntactical structure similar 
to weak Konig’s lemma, are studied in Section 14.2.51 

4.2.5. Compactness and continuity IV. In this section, we study the Weierstrafi max¬ 
imum principle 1 [741 IV.2.2]) and the intermediate value theorem 1 |741 II. 6 .2]). Both 
theorems are equivalent to WKLq, respectively in classical and constructive RM. 

We shall observe that there are (at least) two possible normal forms for each 
of these theorems, called the weak and the strong version, depending on whether 
the consequent applies to the standard world or to all of the universe. By way of 
example, running the weak (resp. strong) version of the intermediate value theorem 
through we obtain the constructive version from [m p. 40] (resp. the uniform 
version from [351 §3] equivalent to (3^)). We again stress that these results are not 
new, but that it is surprising that we rediscover them through i.e. via a purely 
mechanised/syntactical routine without attention to the meaning of the theorems. 

First of all, the aforementioned theorems are interesting because they have the 
same syntactical structure as WKLq, which excludes the (direct) treatment from the 
previous section involving the (effective version of the) fan theorem. In particular, 
the consequent of the aforementioned theorems (when formulated relative to ‘st’) is 
of the form (3®*/^)(V®*a:)(p(/, x), i.e. not the normal form. To obtain our cherished 
normal form and apply O, there are at least two options: 

(1) Apply Transfer to ‘(V®*x)i^(/,x)’ to obtain (3®*/^)(Vx)i^(/,x) as the con¬ 
sequent of the theorem. 

(2) Study the contraposition of the nonstandard theorem (which has the syn¬ 
tactical structure of FAN, and hence a normal form by the previous). 

Hence, there are two normal forms in this case. The strong nonstandard and 
effective versions of the intermediate value theorem (IVT for short) are defined as: 

Theorem 4.23 (IVTns). For standard / : IR —^ IR which is nonstandard continuous 
on [0,1], if f{0) > 0A/(1) < 0 then G [0, l])(/(z) =« 0). 

Theorem 4.24 (IVTef(t)). For / : IR —>■ IR with modulus of continuity g, if f{0) > 

0 A /(I) < 0 then f{t{g, /)) =ir 0. 

For the weak nonstandard version of IVT, let IVT],^ be IVTns with ‘=ir’ in the 
consequent replaced by and the ‘st’ in (V®*/) dropped. Let IVT'f(t) be IVT for 
uniformly continuous functions (with a modulus g) and the consequent weakened 
to (Vfc°)(t(g, k) G [0,1] A \ f{t{g, fc))| < ^), i.e. an approximate intermediate value. 

Kohlenbach has established the equivalence (3t)IVTef(t) GA (3^) in [351 §3]- Fur¬ 
thermore, IVTgf(t) is the constructive version of IVT by [ITl Theorem 4.8, p. 40]. 


^^More technically, Kohlenbach has pointed out in 1461 §3] that theorems classically equivalent 
to WKLq can have a uniform version either at the level of WKLq or at the level of ACAq, depending 
on the original theorem’s constructive status. 
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Theorem 4.25. From the proof of IVTns O II^-TRANS in Po, two terms s, u can 
he extracted such that E-PRA“* proves: 

(V/i2)[MU(m) ^ IVTef(s(/i))] A ^ MU(u(t))]. (4.40) 

From the proof of IVT (,5 in Pq, a term t can be extraced s.t. E-PRA“* h IVT'f(t). 


Proof. The first part of the proof is similar to that of Theorem 14.II For the forward 
implication, the (classical) proof of IVT in [741 II.6.2] goes through in Pq releative 
to ‘st’. Applying II^-TRANS to the consequent of IVT®*, we obtain IVTpj. For 
the reverse implication, assume IVT^s and suppose IIj’-TRANS is false, i.e. there is 
standard h such that (V®*n)/i(n) = 0 A (3m)/i(m) ^ 0. Now define the standard 
function /q (which is also nonstandard uniformly continuous) as follows: 


[fo{x)]ik) 


[x-l]{k) 

1 


otherwise 

{3i < k)h{i) ^ 0 A[x 


m) < 


1 


where m{k) is {p,j < k)h(j) ^ 0, if such there is and zero otherwise. Intuitively 
speaking, /o is just x — ^ but ‘capped’ around x = ^. Clearly, there cannot be 
Xq G [0,1] such that fo{xo) = 0, and IVTps yields a contradiction. It is now trivial 
to bring IVTps into a normal form and apply O. 


For the second part, IVT^j follows in the same way as in the first part of the 
proof. We now bring the former into its normal form. Using the normal form for 
continuity as in (EU, we obtain for all / and standard g that 

[(W*fc)(Va;,y e [0,1])(|a; - y| < ^ ^ \f{x)-fiy)\ < p) A f{0) > 0A/(1) < O] 

^(3®*^G[0,l])(V®*/°)(|/(z)|<i)). 

The (contraposition of the) previous formula implies that for all / 

((V®*z e [0, l])(3®*;°)(|/(z)| > i) A /(O) > 0 A /(I) < 0) (4.41) 

(V®*g)(3"‘fc)(3a;, y G [0,1])(|a; - y\ < -^ A |/(x) - f{y)\ > ^ 

Strengthening the antecedent of (14.411) . we obtain, for all / and standard 

((V®‘z e [0, l]){\f{z)\ > tt^) A /(O) > 0 A /(I) < 0) (4.42) 

^ (W*5)(3"‘fc)(3a;, y G [0,1])(|a; - y| < ^ A |/(x) - f{y)\ > i). 

Now (14.421) clearly has a normal form in Pq and £3 provides a term t such that 
E-PRA"^* proves for all f,g,h that 

((Vz e t{g, h){2))iz G [0,1] ^ |/(z)| > ■^) A /(O) > 0 A /(I) < O) 

^(3x,j/e [0,I])(|x-y| < g(t(g,i)(i)) A|/(x)-/(y)| > 

Again taking the contraposition, we obtain that for all f,g,h that 

((Vx, y G [0,1])(|x -y\< ^ \f{x) - f{y)\ < (4.43) 

A /(O) > 0 A /(I) < O) (3z G t{g, h)(2)){z G [0,1] A |/(z)| < j^) 

which is as requirecJH by the theorem if we take h to be the function which always 
outputs and if g is assumed to be a modulus of (uniform) continuity. □ 


^^Note that we can decide if |/( 2 :)| > ^ or \f(z)\ < ^ for > 0 by |171 Cor. 2.17]. 
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Next, let IVT"^ be IVTns with ‘(3z)’ and instead of and ‘=’ in the 

consequent. We shall also refer to the former as a weak version of IVT. The (proof of 
the) following corollary shows that the second part of the theorem can be improved 
considerably if we consider the meaning/content of the intermediate value theorem 
when obtaining a normal form for the latter. 

Corollary 4.26. From the proof of IVT"^ in H, a term t can be extraced s.t. 

Proof. To prove IVT"^ in H, fix M S n and perform the usual ‘interval halving 
technique’ for M steps using approximations [ • ](M) of all reals involved. By 
continuity, the consequent (3z e [0, l])(/(z) ~ 0) implies (V®*fc°)(3®*i(;)(|/(w)| < 
^). The corollary now follows by applying O with the latter consequent. □ 

Analogous results for WeierstraB’ maximum theorem, and indeed for any the¬ 
orem equivalent to WKLq with the same syntactical structure as WKLq, are now 
straightforward. As an example, the strong nonstandard and effective versions of 
the WeierstraB’ maximum theorem are defined as follows: 

Theorem 4.27 (WEIMAXps). For standard / : IR — >■ IR which is nonstandard con¬ 
tinuous on [0,1], we have (3®*a; G [0, l])(Vy € [0, l])(/(j/) < fix)). 

Theorem 4.28 (WEIMAXei(t)). For any / : IR —>■ R with modulus of continuity g 
on [0,1], we have (Vy G [0, !])(/(?/) < fitif,g))). 

A result analgous to (I4.40p for the previous two sentences, is proved as in the 
proof of the theorem (See also [46] §3]). The weak versions are obtained by the 
same weakening as for IVT. 

Finally, note that for the weak effective version of IVTgf(t), if we additionally 
assume that there is at most one intermediate value, i.e. 

(Vx, y G [0, l])(x f{x) 0 V fiy) 0), 

then the approximation provided by t converges to the unique intermediate value 
of /. The same holds for the WeierstraB maximum theorem (and in general), 
additionally assuming WKL in the base theory to guarantee that a maximum exists 
at all. Unique existence results have been studied in constructive RM ([10]). 

In conclusion, theorems with the same syntactic structure as WKLq seem to have 
two possible normal forms, the strong and weak nonstandard versions. When run 
through £11, the first one gives rise to an explicit equivalence to (/r^), while the 
second one gives rise to the ‘approximate’ version from constructive mathematics. 

4.3. T-wo versions of Dini’s theorem. In this section, we investigate Dini’s 
theorem, which states: A monotone sequence of continuous functions converging 
pointwise to a continuous function on a compact .space, converges uniformly 1 [651 p. 
150]). Our study will lead to a new avenue of research in RM. 

4.3.1. Classical Dini’s theorem. We apply O to Dini’s theorem and we investigate 
the associated Herbrandisation. The latter study turns out to be of independent 
interest, in that it leads to a new avenue of research in RM, namely a third kind of 
explicit equivalences. 
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By m Theorem 5.2], Dini’s theorem for [0,1] implies the latter for any compact 
space. Hence, we shall study the nonstandard version of Dini’s theorem restricted 
to [0,1], as follows. Recall the definition of convergence from Definition l3.14l 

Theorem 4.29 (DINIps). For all fn, f : R —)• R, if 

(V fjfn are nonstandard pointwise continuous for standard n on [ 0 , 1 ], 

(2) fn(x) nonstandard converges to f{x) for standard x € [ 0 , 1 ], and 

(3) (Vx € [0,l],n)(/„(a;) > fn+i(x) > fix)) 

then fn uniformly nonstandard converges to f in [ 0 , 1 ]. 

Theorem 4.30 (DINIef(t)). For all f(.),g(.),f,g,h, if 

(1) /, /n are pointwise continuous on [ 0 , 1 ] with moduli g, gn for all n, 

(2) fnix) converges to fix) with modulus hix)i-) for all x G [ 0 , 11 , and 

(3) iMx G [0, l],n)(/„{a;) > fn+iix) > fix)), 

then fn uniformly converges to f in [ 0 , 1 ] with modulus 

We have the following theorem, with a short and elegant nonstandard proof. 

Theorem 4.31. From Pq h STP ga DINIps, terms s,t can be extracted such that 
E-PRA"^* proves (V/i)(HBLef(h) ^ DINUf(t(/i)) and (Vg)(DINUf( 5 ) ^ HBLef(s(g)). 

Proof. The proof of Dini’s theorem in [3S1 Theorem 13.3, p. 61] is easily seen to 
yield a proof of DINIps inside Pq + STP. For completeness, we now sketch this 
proof. Fix xq G [0,1] and nonstandard Nq, and let standard yo be such that y by 
Theorem 14.161 Now apply overspill (Theorem |2T3]) to (V®*n)(/„(j/o) ~ fnixo)) to 
obtain (Vn < A^i)(/n(?/o) ~ fnixo)) where Ni is nonstandard. If Nq < Ni then 
fixo) ^ /(yo) ~ fNoivo) ~ fNoixo)- If No > Ni, then by assumption: 

fixo) < fNoiXo) < fwAxo) - /iVi(yo) « /(yo) « fixo)- 

In each case, fNoixo) ~ fixo), implying nonstandard convergence as required. 
For the proof of DINIps ^ STP, one could just use Theorem 14.161 and translate 
the results in [HI §4] to Po. We now provide a shorter proof inspired by that of 
Corollary 14.201 To this end, assume DINIps and suppose STP is false, i.e. there is 
xo G [0,1] such that (V®*y G [0,l])(a; 9 ^ y). Now fix nonstandard No and define 
fix) ■■= |,,p_,r|+i/Ao •= i/n+\x-xo\ ■ assumption, these functions 

are nonstandard pointwise continuous for standard n, and clearly monotone as in 
(Vcc G [0, l])(Vn°)(/„(ai) < fn+iix) < fix)). However, we have (V®*x G [0, l])(ViV G 
^)ifNix) « fix)), while /jvo+i(a;o) = No + I Np = fixp), contradicting DINIps, 
and the latter is seen to imply STP by Theorem 14.161 

For the remaining part of the theorem, apply O to HBLps ga DINIps while 
performing the same modifications to the normal forms of HBLps and pointwise 
continuity as was done at the end of the proof of Theorem 14.191 □ 

In the previous theorem, the modulus of uniform convergence provided by the 
term t in DINIef(t) is defined in terms of the functional h as in HBL(/i). In the fol¬ 
lowing remark, we discuss the constructive status of the functional h from HBL(/i). 
We thank Dag Normann for his advice in these matters. 

Remark 4.32 (Fan functional). The term t from the theorem DINIef(t) is a modu¬ 
lus of uniform convergence, defined in terms of moduli of continuity and convergence 
and the functional h satisfying HBL(/i). In other words, the modulus provided by 
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t is only as computable as its inputs. Of course, moduli of convergence and con¬ 
tinuity are ‘part and parcel’ of the constructive or ‘computable’ definition of these 
notions (See [HI Def. 9, p. 43] and U?] Prop. 4.4]), but the constructive status of h 
as in HBL(/i) is not as clear. We now establish that the modulus t{k, h, g, gn) can 
be computed in a specihc technical sense. 

First of all, it is not difficult to show that the functional h can be defined explic- 
itljO in terms of the fan functional defined as follows: 

G C')(V/,g <1 1)(7«>(¥3) =0 g^{^) (/?(/) =0 g’ig)), (4.44) 

where G C is the usuaF^ e-^-definition of continuity on Baire space. Alterna¬ 
tively, as noted just before Corollary 14.211 we could replace the nonstandard com¬ 
pactness in DIN Ins by the (equivalent) nonstandard version of the fan theorem as in 
(14.131) . or even the statement that every (e-(5-)continuous function is nonstandard 
uniformly continuous on Cantor space. This modification would result in HBL(/i) 
being replaced by (essentially) the definition of the fan functional. Serendipitously, 
the fan functional has a computable representation, called a recursive associate (See 
m Theorem 4.2.6]), implemented in Haskell 1|26]'). 

Secondly, all terms in Godel’s T have canonical interpretations in the type struc¬ 
ture of the Kleene-Kreisel countable functionals (See [561 §2] for the latter) and this 
interpretation provides canonical associates. Thus, in Kleene’s second model (See 
e.g. H §7.4, p. 132]), for a term t of Godel’s T and 4) the fan functional, t($) can 
be computed by evaluating the associate for t on the associate for $. 

In conclusion, we observe that the modulus t{k^h,g,gn) from DINIef(t) can be 
computed in a specific technical sense. We do require the existence of the fan 
functional, which however constitutes a conservative extension of WKLq by [351 
Prop. 3.15], and the latter is equivalent to Dini’s theorem. 

Finally, we discuss a new avenue of research in RM, inspired by the fan functional 
in the previous remark and the notion of Herbrandisation. In particular, we will 
formulate the ‘Herbrandisation of STP’, namely the so-called special fan functional. 
The equivalences involving the special fan functional seem to be ‘intermediate’ 
between the Herbrandisation and the conclusion of Theorem 14.311 i.e. there seems 
to be a third level of higher-order RM. We show that that the special fan functional 
give rise to a conservative extension of WKLq, while the relation with the Turing 
jump functional and the effective fan theorem remains unclear. 

We now introduce the special fan functional from §3] as follows: 

Principle 4.33 (SCF(0)). For all binary trees and any g^, 

(Vai G 0(g)(l))(ag(a) 0 T) ^ (V/S^ <i 1)(37° < e{g){2)m ^ T) 

The special fan functional arises as follows: In the proof of Theorem 14.311 the 
nonstandard implication STP —DIN Ins is modified as in the proof of Theorem l4.19l 
Applying O to the resulting modified implication gives rise to explicit ‘vanilla’ 
RM-equivalences, namely involving HBLef(/i). In particular, STP is weakened in 

^^Since all real numbers have a binary expansion in weak classical systems (See m) , any 
functional g{x) as in the antecedent of |HBLef(/i)| gives rise to a continuous mapping on Cantor 
space, and the fan functional as in H4.44|l implies that this functional is bounded, yielding the 
upper bound in the consequent Qf |HBLef (h)| 

^®In particular, ‘ 9 ?^ G C’ is just (yf^){3N^){Wg^){fn = gn^ V^(/) = V^( 5 ))- 
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the aforementioned procedure, and the special fan functional arises when O is 
applied to an unmodified implication involving the equivalent normal form (j4.14|) . 
as is clear from the following theorem. Note that for most of the proofs in [55], a 
weakening of STP did not (seem to) suffice. 

Theorem 4.34. Let (p be internal. From a proof Pq + STP h (V®*a:)(3®*y)(/?(a;, y), 
a term t ean be extracted such that E-PRA“* proves (V0)(SCF(0) (yx){3y € 

t(x,0))<p(x,y)). Furthermore, Pq proves (3®‘^0)SCF(0) STP. 

Proof. The first part is a straightforward application application of O given (14.141) . 
Indeed, let (V®*g^)(3®*?ii^ )B{g,w) be the normal form of (14.141) and apply Corol¬ 
lary 12.51 to the following normal form: 

(V^‘a:, 0)(3^‘2/) [(V5")i?(ff, 0) ^ P’ix, y)]. 

The second part is immediate in light of (14.141) and Definition 12.21 □ 

In light of the final part of the theorem, we refer to the special fan functional as 
‘the Herbrandisation of STP’. To gauge the strength of the special fan functional, 
we need the corresponding ‘full’ fan functional, defined as follows (See e.g. [Ml §3]): 

Principle 4.35 (MUC(4>)). {VY^){yf,g<i l){7<i>{Y) =g<i>{Y) -p Y{f) = Y{g)). 

Comparing the special fan functional to FANef(/i) from Section [4.2.51 one notes 
that the former has a stronger antecedent, namely g only has to witness the fact 
that T has no path for the sequences given by 0((;)(1), rather than all binary 
sequences. Nonetheless, we have the following theorem, where RCAq is just RCAq 
formulated in a functional language (See [Ml §2] for details). 

Theorem 4.36. The systems RCAq -f (30)SCF(0) and Pq -FSTP are conservative 
over RCAq + WKL. 

Proof. For the first system, by [69l Cor. 3.4], the special fan functional can be de¬ 
fined in terms of MUC. By [461 Prop. 3.15], the first conservation result is now imme¬ 
diate. For the second conservation result, let ip he a (necessarily internal) sentence 
in the language of RCAg -F WKL. If Pq -F STP h p, then Pq h (3®*’0)SCF(0) phy 
the second part of Theorem l4.341 Applying Corollarv l2.51 to Pq h (V®'’0)(SCF(0) —> 
p) yields RCAq h (V0)(SCF(0) —>■ p), and we are done. □ 

In light of the previous theorem, the special fan functional is not really stronger 
than WKLq. The same holds for the following effective version of Heine’s theorem. 

Theorem 4.37 (HEIher(i))- For all and all f : R ^ R, g^, if for all k' < t{g, fc)(l) 

(Va; G [0,1] n tig, fc)(2))(Vy G [0, l])(la: - yj < ^ l/(a;) - /(y)| < i), 

then (Vx, y G [0, l])(la: - y\ < 

We have the following corollary to Theorem 14.191 The same result for Dini’s 
theorem is straightforward, but the formulation of the latter is more messy. 

Corollary 4.38. From the proof Pq F STP GA HElps, terms s,t can be extracted 
such that E-PRA'^* proves 

(V0)(SCF(0) ^ HEIher(t(0)) A (V4-)(HEIher(^') ^ SCF(s(4-))). 

Furthermore, Pq proves (3®‘0)HElf,er(0) HEIns. 


(4.45) 
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Proof. In a nutshell, one applies O to STP CD DIN Ins using the normal form (14.1411 

for STP, and the following normal form for HEInsi k", )A{k', g, N, k", v), 

where the internal formula A is as follows: 

(V/ : R ^ R) [(Vfc < k")(Vx e[0,1] n v)(Vg G [0, l])(|a: - y| < \ f{x) - f{y)\ < i) 

^ (Vz, u G [0, l])(|u - z| < i ^ \f{u) - f{z)\ < A)] ■ 

In particular, let )B{g,w) be the normal form of (14.141) and apply 

Corollarv l2.5l to the following normal form: 

g\ 0)(3^‘1V, fc", ) [{Vg^)B{g, 0) ^ A{k', g, N, k", u)]. 

The second part is immediate in light of the normal form of HE Ins and the basic 
axioms from Definition 12.21 □ 

In light of the final part of the theorem, we may refer to HEIher(t) as ‘the Her- 
brandisation of HEIns’- Thus, we have obtained the following three kinds of explicit 
equivalences to which nonstandard equivalences may give rise. 

(1) Explicit equivalences between uniform versions of RM-theorems, like (14.21) . 

(2) The Herbrandisation of RM-equivalences like MTEher(s, t) involving (14.51) . 

(3) Explicit equivalences between Herbrandisations of RM-theorems, like (14.451) . 

The relation between the above three kinds of equivalences is not always clear; In 
particular, we list some open questions regarding the special fan functional. 

(i) Does the existence of the special fan functional as in (30)SCF(0) follow 
from WKL or (3/i)FANef(h)? 

(ii) Is there an explicit implication between the aforementioned functionals? 

(iii) Does nJ-TRANS ^ STP or (3^) ^ (30)SCF(0)? 

(iv) What additional principles (if any) are needed for positive answer to the 
previous questions? 

4.3.2. Constructive Dini’s theorem. In this section, we study the constructive ver¬ 
sion of Dini’s theorem as formulated in [HI Theorem 4]. The latter adds the extra 
data that a very specific sequence Xn (defined in terms of /„ and /) has to have a 
convergent subsequence if we are to conclude uniform convergence. 

A natural question is whether we can obtain the constructive version of Dini’s 
theorem from a suitable nonstandard version, like we did for nonstandard com¬ 
pactness and totally boundedness in Section H.2.21 To this end, let DINIJ,^ be DINIns 
limited to uniformly continuous functions and with the following consequent: 

[(Vn)( 5 (n) < {g{n -f 1))) A {VN G II)(V"*n)(|/(a;„) - /„(a;„)| Ri ||/ - fnllw) 

A (VA:,M G n){xg(^M) « Xg^K))] -t (Vx G [0,l],Af G fI)[/Ar(x) Ri f{x)] 

Clearly, our nonstandard version DINI^.^ is inspired by [HI Theorem 4], but is per¬ 
haps more intuitive: In order to guarantee uniform convergence, the sequence X(.) 
has to be such that |/(x„) — /n(xn)| witnesses the sup norm ||/ — fn\\N and such 
that Xg(.) is a convergent subsequence. Note that the limitation to uniformly (non¬ 
standard) continuous functions is necessary for the step (14.471) in the proof, and 
also for the ‘general’ existence of the supremum norm. 

Theorem 4.39. The system E-PRA“j* proves DINIJ,^. 


(V"*X(.),5) 
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Proof. Let /,/n,X(.),g be as in DINI^^ and fix yo G [0,1] and Nq G Q. Applying 
overspil0 to the fact that for all standard m, we have 

gijTl) < Nq a / {Xg(^m) ) f g(nn) {Xg(m) ) ~ 11/ f g(m) IInq ^ / (2 /o) f g(m) {Uo ) t (4.46) 
yields that (14.461) holds for m < Mq G fl. Now consider the following inequalities: 

0 < f{yo) - fNoiyo) < f{yo) - fg{Mo)(.yo) $ 11/ - fgiMo)\\No (4.47) 

~ f {^g(Mo)) ~ fg{Mo){^g(Mo))- (4.48) 

Note that the final two steps follow from (14.4611 for m = Mq. By fl-CA, there is 
a standard real a such that {\/N G n)(a Xn)- Clearly, we have by continuity 
that /(xg(Mo)) ~ /(a) and (V''*n)(/„(a;g(Mo)) ~ fn{a)). Applying overspill to the 
latter (technically with resolved), we obtain for some infinite such that 
(Vn < Ni){fn{xg(Mo)) ~ /n(a)). Now, clearly /wi(a:g(Mo)) ~ /iVi(a) ~ /(a) by 
pointwise nonstandard convergence. However, by the monotone behaviour of /„ 
and the continuity of /, we have for m > Ni that /vi(a^g(Mo)) ^ /m(^g(Mo)) ^ 
f{xg(Mo)) ~ /(g ). Th e previous implies that (Vm G ^){fm{Xg(Mo))) ~ /(«)■ Hence, 
the n umber in (|4.48|) is an infinitesimal, i.e. f{xg(Mo)) ~ /(a) « fg{Mo){Xg(Mo))- 
Then (14.471) implies /(j/o) ~ fNoivo) and we are done. □ 

It is clear that for the previous proof, we drew inspiration from the final part of 
the proof of Theorem 4]. However, our proof is arguably shorter, as we do not 
need m Prop. 3]. It is now a tedious but straightforward derivation to obtain the 
effective version of DINI],^, which is highly similar to m Theorem 4]. 

Finally, the proof of Theorem 14.391 also goes through in the constructive system 
H, and there appears to be a ‘recursive’ version of Dini’s theorem ([38]) in which 
compactness is witnessed by a recursive function. 

4.4. Stone-Weierstrass theorem. In this section, we study the Stone- Weierstrass 
theorem SWT (See [65l 7.32]). In this context, S is called a separating set for C if 

(Vx, y G C)i3f G S){x ^ y ^ f{x) + f{y) (4.49) 

Theorem 4.40 (SWT). An algebr^^ of continuous functions with a separating 
set for the compact domain is dense in the continuous functions on the domain. 

Now, there are constructive versions of SWT (See [TT] p. 106], |9T1 §4], and [20l 
§4]), but they all involve the same complicated notion of ‘constructive separating 
set’, and it is a natural question (in light of our treatment of compactness and 
constructive Dini’s theorem) whether there is a more elegant nonstandard notion 
of separating set which gives rise to the notion of constructive separating set after 
applying O. We shall provide a positive answer to this question in this section. 

First of all, we introduce the following definition, arguably quite similar to (14.491) . 

Definition 4.41. (nonstandard-separating set] The set S of functions f : C ^ D 
is a nonstandard-separating set for C if 

e S){x ^ f{x) ^ /(y)). (4.50) 


^^Note that and in H4.46ft can also be replaced by a universal formula. 

^®We require an algebra to contain the constant functions so as to satisfy Rudin’s non-vanishing 
criterion from |65l Theorem 7.32]. 
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We shall now obtain a normal form for (j4.50l) . To this end, note that SWT 
deals with separating sets for compact domains for continuous functions; Thus, 
nonstandard compactness (as studied in the previous section) seems particularly 
useful to remove the outermost ‘st’ in (14.501) . as we prove in the next theorem. The 
latter can be proved in H or Pg. 

Theorem 4.42. If C is nonstandard compact and has a nonstandard-separating 
set S of nonstandard continuous functions, then there is standard d with 

y e C')(3^V e [Icr - y| > i ^ \f{x) - f{y)\ > . (4.51) 

Proof. Let C, S be as in the theorem and consider (14.501) . Resolving ‘ss’, we obtain 

(W‘fc)(V^‘x, y e C)(3^*/ e 5, N){\x - y\ > i ^ \f{x) - f{y)\ > i), (4.52) 

with all standard quantifiers pushed forward as much as possible (which can also 
be done inside H by following the proof of Corollary ITTI) . As C is nonstandard 
compact and / as in (14.521) is nonstandard continuous, we obtain 

(V«tfc)(Vx, y e C)(3^V e iV)[|a: -y\>k^ \f{x) - f{y)\ > A]. (4.53) 

Indeed, for every x,y € C there are standard x',y' such that x' pe x and y' k, x 
by nonstandard compactness. Nonstandard continuity yields fix) ~ fix') and 
fiy) w fiy') for the / from (I4.52|) . and (14.531) now follows. 

Applying idealisation I (or NCR in the case of H) to (14.531) . we obtain 

(W*A:)(3^V',fV')(Va:,2/ G C)(3/ G f ,fV G iV')(/ G SA[\x-y\ > i ^ |/(x)-/(y)| > A]). 

Now apply HACint to obtain standard 4) such that f',N' G 4>(fc). Let d(fc) be the 
maximum of all entries for N' and note that 

(V^‘A:)(Va:, 2 / G C)(3^‘/)(/ S A [\x - y\ > ^ ^\fix) - /(y)| > ^]), 

by ignoring the components for /' and / of 4*. □ 

As is clear from the proof, since we are working over a nonstandard compact set, 
the distinction between pointwise and uniform continuity is not that relevant. 

Secondly, as we have pointed out before, HACipt only provides witnessing func¬ 
tionals for type zero existential quantifiers (and similarly monotone objects). Hence, 
it seems impossible to obtain a witnessing functional for (3/ G S) as in (14.511) . Per¬ 
haps surprisingly, we can obtain a modulus of continuity for this function /. 

Corollary 4.43. If C is nonstandard compact with a nonstandard-separating set 
S of nonstandard continuous functions, then there is standard d, e with 

(W‘fc,A')(V^‘^W G C)(3^‘/ G S){Cif,eik'),k')A[\x-y\ > i ^ |/(x)-/(y)| > ^]), 

where C(/, e(fc'), fc') = (Va;',y' G C)i\x' -y'\ < ^ -A |/(x') - fiy')\ < p). 

Proof. Similar to the proof of the theorem, but with the addition of ‘/ is uniformly 
nonstandard continuous on C’ inside the square brackets in (14.511) . Note that uni¬ 
form continuity follows from usual continuity due to the nonstandard compactness 
of C. After resolving the new version of formula (14.531) becomes 


i'd^^k,k')i\/x,y G C')(3^‘/ G S,N,N')iCif,N',k')A[\x-y\ > i ^ \fix)-fiy)\ > i]), 
and the rest of the proof is now straightforward. □ 
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In short, Corollarv l4.43l tells us that the images of x and y are not only ‘effectively 
separated’ by d as in (I4.51L but also that we effectively know the continuity of / 
around x and y thanks to e. Furthermore, it is easy to guarantee that for certain 
x,y & C, f{x) = 0 and f{y) = 1 by defining g{-) := where XQ,yQ are 

the standard parts of x, y provided by nonstandard compactness. 

We now invite the reader to compare the complicated definition of a constructive 
separating set as in [171 Def. 5.13. p. 106] to Corollary 14.431 Clearly, the functional 
‘e’ from Corollary 14.431 olavs the role of 6 in [ni Def. 5.13. p. 106], and we observe 
that the normal form as in Corollary 14.431 of the of the notion of nonstandard- 
separating set gives rise to the constructive notion of separating set. 

In conclusion, like in the case of compactness, the constructive version of ‘sep¬ 
arating set’ falls out of the nonstandard one, again with surprisingly little effort. 
Furthermore, if we formulate nonstandard density as (V’**’/ S C{X))(3g € G)(Vx G 
X){f{x) ~ 9 {x)), then the corresponding nonstandard version of SWT gives rise to 
the constructive version of SWT as in ini p. 106, 5.14]. 

4.5. The strongest Big Five. In this section, we study equivalences relating to 
ATRq and n]-CAo, the strongest Big Five systems from RM. The associated results 
show that the template £3 also works for the fourth and fifth Big Five system. 

We shall work with the Suslin functional (S'^), the functional version of n]-CAo. 

(3^2)(V/1) [5(/) =0 0 o {3g^){'ix°){f{gx) ^ 0)]. {S^) 

Feferman has introduced the following version of the Suslin functional (See e.g. |2]). 

(3Al^^)[(V/^)((35^)(Va;°)(/(ga;) yf 0) i'ix°){f{gi{f )x) yf 0))], {m) 

where the formula in square brackets is denoted MUO(/ri). We shall also require 
another instance of Transfer, as follows: 

(V/i) [{3g^){\/x°){f{gx) ^ 0) ^ {3^^g^){'^^x°){f{gx) ^ 0)]. (n}-TRANS) 

The equivalence between n]-TRANS and {S'^) was proved in jSj. 

We shall obtain an effective version of the equivalence proved in [STJ Theo¬ 
rem 4.4]. The relevant (non-uniform) principle pertaining to the latter is PST, i.e. 
the statement that every tree with uncountahly many paths has a non-empty perfect 
subtree. The latter has the following nonstandard and effective versions. 

Theorem 4.44 (PSTns). For all standard trees , there is standard such that 
(V/°(^^)(3/ G P)(yn){fn yfi /) —:► P is a non-empty perfect subtree of T] , 

Theorem 4.45 (PSTef(t)). For all trees , we have 

(V/°y^^)(3/ G P){'in){fn y^i /) —>• t(T) is a non-empty perfect subtree of T] . 

Note that the property of being a non-empty perfect subtree consitutes an arith¬ 
metical formula as in [71 Definition V.4.1] and (14.571) below. As a technicality, we 
require that P as in the previous two principles consists of a pair {P',p') such that 
P' is a perfect subtree of T such that p' G P'. We have the following theorem. 

Theorem 4.46. From the proof of PSTns GA n]-TRANS in Pq, two terms s,u can 
be extracted such that E-PRA"^* proves: 

(Vaii) [MUO(aii) -a PSTef(s(/ri))] A [PSTef(t) ^ MUO(u(t))]. (4.54) 
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Proof. We first establish the ‘easy’ implication II^-TRANS —^ PSTps. Clearly, 
nJ-TRANS implies IlJ-TRANS and the former implies: 

(WV')(3^*5')[(3g')(Vx°)(/(ga:) ^ 0) ^ (Vx°)(/(ga:) ^ 0)]. (4.55) 

Applying HACint, there is standard $ such that S As noted in the 

proof of Theorem l4.ll IlJ-TRANS implies (3^)®* and the latter can be used to check 
which of the possible witnesses g G '!>(/) is such that (V®*a;°)(/(ga;) ^ 0). Hence, 
there is standard ih such that 

(WV')[(35')(Vx°)(/(5x) ^ 0) ^ (W‘x°)(/(Wx) ^ 0)]. 

Since Hj’-TRANS is available, this implies 

(WV')[(3^*5')(V^*x°)(/(5x) ^ 0) ^ (W*x°)(/(¥(7)cr) ^ 0)], 

which is exactly (/ii)®*. The latter implies HJ-CAq relative to ‘st’, and we obtain 
PST*** by performing the proof in [za V.5.5] relative to ‘st’. As the property of 
being a perfect subtree is arithmetical, we can use n°-TRANS to drop all instances 
of ‘st’ in this property. Hence, we obtain 

(V®*T)(3®*P) G P){V^*'n){fn /) ^ P is a non-empty perfect subtree of T]. 

Thanks to n)-TRANS, we now obtain: 

(V®*T)(3®*P) [(V/ji)(3/ G P){yn){f„ =1 /) —>• P is a non-empty perfect subtree of T], 

which is exactly PSTps. The implication Hj-TRANS PSTps is easily brought 
into the normal form in light of (|4.55|) . Applying Corollary 12.51 now provides a 
witnessing term, from which the right witness can be selected using (3^), as ‘being 
a perfect subtree’ is arithmetical. 

Next, we establish the remaining implication PSTps ^ n}-TRANS. First, assume 
H^-TRANS and hx standard / such that {3g^){\/x°)f{gx) = 0 and dehne: 

a€To^(yi< |CT|/2)(/(cr(0) * cr(2) :(=... a(2i)) = 0). (4.56) 

By assumption, the tree Tq has uncountably many paths (in the internal sense of the 
antecedent of PSTps), and we may conclude the existence of a standard non-empty 
subtree Pq = (Pg,Po). The dehnition of perfect subtree for Pq is 

(Vct G Po)(3ri, T 2 G Pq) [cr C n A ct C r 2 A n, T 2 are incompatible], (4.57) 

where ‘incompatible’ means that neither sequence is an extension of the other. Note 
that the formula in square brackets in (14.571) is quantiher-free. We obtain 

(V®*cr G Pg)(3®*ri, T 2 G Po)(cr C n A cr C r 2 A n, r 2 are incompatible), (4.58) 

using Hj-TRANS due to the standardness of Pq. Since pg G Pg and pg is standard, 

(I4.58P implies that there is a standard sequence pg such that (V®‘x°)(^x G Pg). 

By the dehnition of Tg, we obtain that (3®‘p^)(V®*x°)/(px) = 0. Hence, we have 
obtained Hj-TRANS assuming H^-TRANS, and we now show that the latter is also 
implied by PSTps. To this end, hx standard and suppose (3n)/i(n) ^ 0. Dehne 
/(cr) = 0 ih /i(cr(0)) ^ 0 and note that (3p^)(Vx°)/(px) = 0. We again consider Pg 
and obtain a standard perfect subtree Pg of Pg such that standard pg G Pg. The 
latter implies (3®*n)/i(n) 0 by the dehnition of /, and H^-TRANS follows. 

Finally, the implication PSTps —>■ [Hj-TRANS A H^-TRANS] is easily brought into 
the normal form in light of (14.31) and (14.551) . Applying Coroharv l2.5l now provides 
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a witness to (as in the proof of Theorem 14.1|1 and a finite sequence of possible 
witnesses for (^i), and the right one can be selected by the first witness. □ 

It is straightforward to obtain the Herbrandisation of n}-TRANS V)- PSTps and 
obtain the ‘equivalence’ between these two as in Corollary 14.21 

Corollary 4.47. In RCAq , (^i) •(->■ (3t^^^)PSTef (t) and this equivalence is explicit. 

In light of the intimate connection between theorems concerning perfect kernels 
of trees and the Cantor-Bendixson theorem for Baire space (See [74l IV. 1]), a version 
of Theorem 14.461 for the former can be obtained in a straightforward way. Another 
more mathematical statement which can be treated along the same lines is every 
countable Abelian group is a direct sum of a divisible and a reduced group. The 
latter is called DIV and equivalent to IlJ-CAo by [TU VI.4.1]. By the proof of the 
latter, the reverse implication is straightforward; We shall study DIV IlJ-CAo. 

To this end, let D\\/{G,D,E,h) be the statement that the countable Abelian 
group G satisfies G = D (B E, where I? is a divisible group and E a reduced group. 
The nonstandard version of DIV is as follows: 

(Vst(^)(3st^, [DIV(G, D,E)ADf^ {Og} ^deD], (DIVns) 

where we used the same technicality as for PSTns- The effective version is: 

(VG)[DIV(G,t(G)(l),t(G)(2)) At(G)(l) ^ {Og} ^ t{G){3) G t(G)(l)]. (DIV,f(t)) 

We have the following (immediate) corollary. 

Corollary 4.48. From the proof of DIVns — t n}-TRANS in Pg, a term u can be 
extracted such that E-PRA"^* proves: 

[DlVef(t) ^ MUO(M(t))]. (4.59) 

Proof. The proof of the nonstandard implication is similar to that of the theorem. 
Indeed, define Tq as in (|4.56l) with the same assumptions on /. Define the Abelian 
group Go with generators Xr, t G Tq and relations pxr = Xp, t = p * {i), and 
XQ = 0 (This definition is taken from [TU p. 231]). Since / is standard, so is Tq 
and Go, and since {3g^){Vx°)f{gx) = 0, the divisible group D provided by DIVns is 
non-trivial. Hence, there is standard d € D, and using H^-TRANS on the definition 
of divisible subgroup as in the proof of the theorem, we obtain a standard path 
through Tq and hence (3®*g^)(Va:°)/(ga:) = 0, and n]-TRANS follows. To obtain 
(|4.59|1 . proceed as in the proof of the theorem. □ 

It is straightforward to obtain the Herbrandisation of n}-TRANS ga DIVns and 
obtain the ‘equivalence’ between these two as in Corollary 14.21 We trust the reader 
to discern a template for equivalences related to Hj-CAg from the above. 

Finally, we point out a uniform version of PST at the level of ATRq, as follows: 

Theorem 4.49 (PST{f(t)). For all we have 

(V/(.))(Vn)[g(/(.)) G PAfn 5(/( ))] t{T,g) is a non-empty perfect subtree of T. 

Clearly, PST{f (t) is just PST^f (t) with a witnessing functional for the antecedent. 

It is straightforward to derive (3t^^“*'^i^^)PST{f (t) in RCAg-kQF-AC-|- (3^) -|-ATRg. 
The nonstandard version PSTns can be weakened similarly by introducing such 
standard g, and the associated term extraction result is straightforward. 
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4.6. Algebraic theorems. In this section, we apply the template O to some 
theorems from the RM of ACAq which are algebraic in nature, like for instance |741 
1.9.3.5-8] or [TU 1.10.3.9-11]. The vague and heuristic notion of algebraic theorem is 
meant to capture those (internal) theorems T of the form T = (VA^)(3y^)i^(A, Y) 
where (f is arithmetical. We shall obtain two kinds of explicit equivalences, one 
using the ‘standard extensionality trick’ from Section 14.11 

We study TOR, which is the statement that a countable abelian group has a 
subgroup consisting of the torsion elements (See [741 III.6]), and show how other 
theorems can be treated analogously in Template 14.531 In other words, we show 
that £3 applies to a large group of theorems from the third Big Five category. 

First of all, in contrast to notions from analysis like continuity, there is no obvious 
nonstandard version of the notion of torsion subgroup. Nonetheless, there is an 
‘obvious’ nonstandard version of TOR itself, as we discuss next. Now, TOR has 
the form (VG^)(3r^)TOR(G,T), where TOR(G,T) expresses that T is a torsion 
subgroup of G, i.e. we have that 

T C G A (V5 e G)[ff e T o iBn)ing = Og)]. (4.60) 

In 1ST and using the axiom Transfer, TOR implies (V®*G^)(3®‘T^)TOR(G,T), our 
cherished normal form. We can however obtain more information: The formula 
(14.601) implies that (V®*g G G)[g € T —5> (3®*n)(n Xg g) = Og], for standard G 
and T, again using Transfer. Applying the axiom of choice (relative to ‘st’), TOR 
implies the following normal form, which we shall refer to as TORps. 

(V^‘Gi)(3^‘A\Ti C G)[(Vg € G,m)[mg = 0G^g€T] 

A[g GT ^ h{g)g = Og]] ■ (4.61) 

In conclusion, TORps is just TOR brought into the normal form with a functional 
h witnessing the ‘torsion-group-ness’ of T as in (14.611) . 

Secondly, we argue that (14.6111 is natural from the point of view of Brattka’s 
framework from [5]. Indeed, in the latter, mathematical theorems are interpreted 
as operations mapping certain input data to output data in a computable fashion. 
Now, such operations may be assumed to be standard in 1ST; Indeed, for a theo¬ 
rem of the form {\/x)(3y)ip{x, y), it is the ‘explicit’ version (yx)ip{x, $(a:)) which is 
studied and classified according to the computational content of $ in [5] ; Assuming 
Transfer from 1ST (while the much weaker PF-TPy from [8] suffices), the sentence 
(3$)(Vx)i^(ai, 4>(a::)) immediately yields (3®*<l>)(Vx)(^(a:, $(a:)). Since standard in¬ 
puts yield standard outputs for standard operations, we obtain {\/^^x){3^^y)(p{x,y). 
In other words, the nonstandard version (|4.61l) naturally emerges from Brattka’s 
framework as in [5]. 

In light of the above considerations, TORps is natural and we define TORef(t) as 
the statement that (VG^)A(G, t(G)(l), <(G)(2)) where A{G,T,h) is the formula in 
big square brackets in ()4.61|1 . 

Theorem 4.50. From the proof o/n^-TRANS VD TORps in Po, terms s,u can be 
extracted such that 

(VAt^)[MU(M) ^TORef(s(/r))] A (Vt^^^) [TORef(t) ^ MU(M(f))]. 


(4.62) 
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Proof. To prove nJ-TRANS —?> TORns, note that the antecedent implies (3^)®* (as 
in the proof of Theorem 14.111 . Following the proof of [74l III. 6 .2] relative to ‘st’, we 
obtain TOR®*. Alternatively, the latter can be obtained by defining the subgroup 
Tm as {g £ G : (3n < M){ng = Og)}, and applying fl-CA after observing (VA^, M £ 
fl)(TM ~i T/v). From TOR®*, (14.611) now follows from II^-TRANS and HACint. 

To prove TORps —>• nJ-TRANS, suppose the consequent is false, i.e. there is 
standard /i* such that (V®*n)/i(n) = 0 A (3mo)h(mo) ^ 0. Let po be a prime number 
such that (3i < po)h(i) ^ 0 and consider the multiplicative group of integers modulo 
POi usually denoted Z/poZ. This group can be defined in terms of h (only) and is 
therefore standard. Applying TORps, every standard element in J.IpqI. is in the 
torsion subgroup and becomes zero after being multiplied standardly many times. 
This contradiction yields the required nonstandard equivalence, and the rest of the 
theorem follows by applying £3 as in the proof of Theorem 14.11 □ 

It is straightforward to obtain the Herbrandisation of fl^-TRANS CA TORps and 
obtain the ‘equivalence’ between these two as in Corollary 14. 2 1 

Corollary 4.51. The explicit equiv. [p?) -fA (3t*“’'*)TORef (t) is provable in RCAq . 

Overall, the proof of TORps AA II^-TRANS seems simpler than the proof of 
TOR AA ACAo in [Til IIL6.2]. On top of that, we obtain an explicit equivalence in a 
purely algorithmic fashion. Again, the RM of Nonstandard Analysis seems simpler 
and provides more explicit information. 

Next, we use the ‘standard extensionality trick’ from Corollary 14.41 to obtain an 
even simpler explicit implication. 

Corollary 4.52. From the proof in Pq of 

( 3 ®*$) [(V®*G*)TOR(G, $(G)) A $ is standard extensional] ^ n°-TRANS, (4.63) 

a term u can be extracted such that 

(Vt*^*)[(VG*)TOR(G,t(G)) ^ MU(u(t,S))]. (4.64) 

where S is an extensionality functional for t. 

Proof. To prove (I4.63L assume the latter’s antecedent and suppose n^-TRANS is 
false. Now consider h and J-IpqI. as defined in the proof of the theorem. Note 
that the multiplicative group (Z, x) satisfies, with slight abuse of notation, that 
(Z/poZ) Z. However, the torsion subgroup of Z (resp. (Z/po^)) is {0} (resp. 
includes 1), and we obtain $(Z/poZ) 761 $(Z), a contradiction. In light of the latter, 
we obtain (14.631) , and (14.641) now follows by bringing standard extensionality in the 
former into the normal form and applying O as in the proof of Theorem 14.11 □ 

Comparing (|4.62l) and (14.641) . we note that the latter does not require effective 
information like the function h in (I4.61L while the former does not require an 
extensionality functional. As the latter is merely an unbounded search, the version 
(14.641) seems preferable. However, the existence of an extensionality functional is 
not an entirely innocent assumption, as discussed in |481 Remark 3.6]. 

We now sketch a template for treating other algebraic theorems, like those men¬ 
tioned at the beginning of this section, in the same way. Recall that ‘algebraic 
theorem’ is meant to capture those (internal) theorems T which are of the form 
T = (VA*)(3F*)(/?(A,y), where p is arithmetical. 
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Template 4.53 (Algebraic theorems). If Lp involves existential quantifiers, we bring 
those outside (if possible) or introduce functionals to remove them. For instance, if 
(/?(A1, Y) = (Vn)(3m)(/3o(Al, Y) with quantifier-free, then we consider the formula 
(VX)(3y,h)(Vn)(^o(^,b^n,h(n)). li piX,Y) = (Vfc)i/>(X, F, fc) ^ {\/n)MX,Y) 
with <po,ipo quantifier-free, then we consider 

{\/X){3Y,k)['4)oiX,Y,k) (yn)ipo{X,Yn, h{n))]. 

Hence, we obtain a formula of the form (VAr^)(3F^)(Vn)(/3o(Af, Y, n) with (po quantiher- 
free. Our nonstandard version Tps is then defined as (V®*Ar^)(3®*F^)(Vn)v5o(Ar, Y, n). 

If T is equivalent to ACAq, or equivalent to WKLq and has the same syntactical 
structure as the latter, the proof of H^-TRANS o T„s gives rise to an explict equiv¬ 
alence involving (/i^) as in Theorem 14.501 Alternatively, prove 

(3®*<I>) [(VX^)(/?(X, <I>(Ar)) A $ is standard extensional] —>■ H^-TRANS, 

and proceed as in the proof of Corollary 14.521 

We finish this section with some remarks. 

Remark 4.54 (Other frameworks). As noted in the proof of Corollary 12.51 the 
approach from [7] is quite modular in that it does not depend on one particular 
formal system, but goes through in any system in which finite sequences can be 
coded easily, like EFA. Hence, it should be possible to formulate Theorem 12.41 for 
a system based on Brattka’s framework from [5]. Alternatively, one could ‘break’ 
functional extensionality (absent in the Brattka’s framework) by working with finite 
sets rather than finite sequences. 

Remark 4.55 (Measure theory). The usual definition of measure is used in RM 
(See [74l X.I.2]). However, the existence of this measure for all open sets (as the 
usual supremum) is equivalent to ACAq. Of course, we can run the nonstandard 
version of this equivalence through O with predictable results, but the essential 
role played by arithmetical comprehension does not (seem to) bode well for the 
development of measure theory in any ‘computable’ fashion. 

Nonetheless, while may not be meaningful in RCAq, the inequality p,{A) <ir 
always makes sense in the latter system (See [TH X.I]). As it turns out, such 
inequalities suffice for many measure theoretic theorems, and there even exists a 
similar treatment of the Loeb measure ([25]). With this ‘relative’ definition of 
measure in place, a number of theorems from measure theory have been classified 
as equivalent to WWKLo, a weaker version of WKLq (See [TH X.I]). It would be 
quite interesting to study both the Lebesgue and Loeb measure using O. 

5. The bigger picture of Nonstandard Analysis 

In this section, we discuss the constructive and non-constructive aspects of Non¬ 
standard Analysis, especially in light of our results and some current developments. 

First of all, it is important to point out the existence of Constructive Non¬ 
standard Analysis (See [62] for an incomplete list). In particular, both Robinson’s 
model-theoretic/semantic approach f [50l[66] l and Nelson’s syntactic approach ([55]) 
to Nonstandard Analysis have associated constructive versions. For instance, a 
nonstandard model is constructed inside Martin-Lof’s constructive type theory in 
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[591160] , while a version of Nelson’s internal set theory compatible with Bishop’s Con¬ 
structive Analysis is studied in [3 §5]. It is also worth mentioning the nonstandard 
type theory introduced by Martin-L6f himself in m- 

Now, in the constructive approach to Nonstandard Analysis, the principles Trans¬ 
fer, Standard Part, Saturation which connect the standard and nonstandard uni¬ 
verse, are sufficiently weakened so as to be compatible with constructive mathe¬ 
matics. Hence, the presence of nonstandard objects (in a model or system) is not 
necessarily non-constructive, but the principles connecting the standard and non¬ 
standard universe can be. For instance, a rather weak instance of the Transfer 
principle already implies Turing’s Halting problem by [H Cor. 12]. 

Secondly, despite the observations from the previous paragraph, Bishop (See 
[la p. 513], [la p-1], and [M], which is the review of [43]) and Connes (See [32 p. 
6207] and [211 p. 26]) have made rather strong claims regarding the non-constructive 
nature of Nonstandard Analysis. Their arguments have been investigated in re¬ 
markable detail and were mostly refuted (See e.g. [531H01H3] 1. Following the results 
in this paper (and especially given our study of Herbrandisations), we can conclude 
that the praxis of Nonstandard Analysis is highly constructive in nature, in direct 
opposition to the Bishop-Connes claims. 

Thirdly, the program Univalent foundations of mathematics (See [95] for a com¬ 
prehensive treatment) is usually described as: 

Vladimir Voevodsky’s new program for a comprehensive, computa¬ 
tional foundation for mathematics based on the homotopical inter¬ 
pretation of type theory. (See [96]) 

Our results suggest that Nonstandard Analysis already provides a computational 
foundation for mathematics inside the usual foundational system ZFC. In particu¬ 
lar, our approach does not require one to strictly adhere to intuitionistic logic. 

Fourth, Tao has on numerous occasions discussed the connection between so- 
called hard and soft analysis, and how Nonstandard Analysis connects the two 
(See ^3] §2.3 and §2.5]). Intuitively speaking, soft (resp. hard) analysis deals 
with qualitative (resp. quantitative) information and continuous/infinite (resp. dis¬ 
crete/finite) objects. It seems the ‘hard versus soft’ distinction was made by Hardy 
(] [321 p. 64]) in print for the first time. It goes without saying that the template £3 
from Section r3.5l Drovides a ‘direct one way street’ from soft analysis stemming from 
(pure) Nonstandard Analysis to hard analysis embodied by the effective theorems. 
In turn, the Herbrandisation of a theorem allow us to jump to soft analysis from 
the hard version, as discussed at the end of Section [3T] 

Finally, it is fitting that the results in this paper combine two of Leibniz’ well- 
known research interests, namely the infinitesimal calculus and his calculemus 
views; The latter in the guise of the template CU. Indeed, following Turing’s nega¬ 
tive solution ( [84 ] ) to Hilbert’s Entscheidungsproblem, it is impossible to ‘compute’ 
the truth of mathematical theorems; Moreover, the classification provided by the 
program Reverse Mathematics (See Section 12.211 suggests that most mathematical 
objects and theorems are non-computable (in a specific technical sense). Despite 
this pervasive and seemingly ubiquitous non-computability of mathematics, the 
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theorems proved in (pure) Nonstandard Analysis turn ont to have lots of compn- 
tational content, and to bring ont the latter, one need only follow Leibniz’ dictum 
Let us calculate!^ i.e. follow the template O. 

Acknowledgement 5.1. This research was supported by the following funding 
bodies: FWO Flanders, the John Templeton Fonndation, the Alexander von Hnm- 
boldt Foundation, and the Japan Society for the Promotion of Science. The author 
expresses his gratitude towards these institutions. The author would like to thank 
Grigori Mints, Ulrich Kohlenbach, Horst Osswald, Helmut Schwichtenberg, Stephan 
Hartmann, and Dag Normann for their valuable advice. 


References 

[1] Sergio Albeverio, Raphael Hpegh-Krohn, Jens Erik Fenstad, and Tom Lindstrpm, Nonstan¬ 
dard methods in stochastic analysis and mathematical physics, Pure and Applied Mathemat¬ 
ics, vol. 122, Academic Press, 1986. 

[2] Jeremy Avigad and Solomon Feferman, GodeVs functional (“Dialectica”) interpretation, 
Handbook of proof theory, Stud. Logic Found. Math., vol. 137, 1998, pp. 337—405. 

[3] Jeremy Avigad and Jeremy Helzner, Transfer principles in nonstandard intuitionistic arith¬ 
metic, Archive for Mathmatical Logic 41 (2002), 581-602. 

[4] Michael J. Beeson, Foundations of constructive mathematics, Ergebnisse der Mathematik 
und ihrer Grenzgebiete, vol. 6, Springer, 1985. Metamathematical studies. 

[5] Vasco Brattka and Guido Gherardi, Effective choice and boundedness principles in com¬ 
putable analysis. Bull. Symbolic Logic 17 (2011), no. 1, 73-117. 

[6] Vasco Brattka and Gero Presser, Computability on subsets of metric spaces, Theoret. Gomput. 
Sci. 305 (2003), no. 1-3, 43-76. Topology in computer science (Schlofi Dagstuhl, 2000). 

[7] Benno van den Berg, Eyvind Briseid, and Pavol Safarik, A functional interpretation for 
nonstandard arithmetic, Ann. Pure Appl. Logic 163 (2012), no. 12, 1962-1994. 

[8] Benno van den Berg and Sam Sanders, Transfer equals Comprehension, Submitted (2014). 
Available on arXiv: http://arxiv.org/abs/1409.6881 

[9] Josef Berger and Peter Schuster, Dini’s theorem in the light of reverse mathematics, Logicism, 
intuitionism, and formalism, Synth. Libr., vol. 341, Springer, 2009, pp. 153-166. 

[10] Josef Berger and Hajime Ishihara, Brouwer’s fan theorem and unique existence in construc¬ 
tive analysis, MLQ Math. Log. Q. 51 (2005), no. 4, 360-364. 

[11] Ulrich Berger, Uniform Heyting arithmetic, Ann. Pure Appl. Logic 133 (2005), 125—148. 

[12] Errett Bishop, Foundations of constructive analysis, McGraw-Hill Book Go., New York, 1967. 

[13] _, Aspects of constructivism. Notes on the lectures delivered at the Tenth Holiday 

Mathematics Symposium, New Mexico State University, Las Gruces, December 27-31, 1972. 

[14] _, Review of [43] . Bull. Amer. Math. Soc 81 (1977), no. 2, 205-208. 

[15] _ , The crisis in contemporary mathematics. Proceedings of the American Academy 

Workshop on the Evolution of Modern Mathematics, 1975, pp. 507-517. 

[16] _ , Mathematics as a numerical language, Intuitionism and Proof Theory (Proc. Conf., 

Buffalo, N.Y., 1968), North-Holland, 1970, pp. 53—71. 

[17] Errett Bishop and Douglas S. Bridges, Constructive analysis, Grundlehren der Mathematis- 
chen Wissenschaften, vol. 279, Springer-Verlag, Berlin, 1985. 

[18] Douglas S. Bridges, Dini’s theorem: a constructive case study, Gombinatorics, computability 
and logic (Constanta, 2001), Springer, 2001. 

[19] Douglas S. Bridges and Lumini^a Simona Vi^a, Techniques of constructive analysis, Univer- 
sitext, Springer, New York, 2006. 

[20] Douglas K. Brown, Notions of compactness in weak subsystems of second order arithmetic, 
Reverse mathematics 2001, Lect. Notes Log., vol. 21, Assoc. Symbol. Logic, 2005, pp. 47-66. 

[21] Alain Connes, An interview with Alain Cannes, Part I, EMS Newsletter 63 (2007), 25-30. 
http: //www. mathematics-in-europe. eu/maths-as-a-prof ession/interviews 

[22] _ , Noncommutative geometry and reality, J. Math. Phys. 36 (1995), no. 11, 6194—6231. 

[23] Hannes Diener and Iris Loeb, Constructive reverse investigations into differential equations, 
J. Log. Anal. 3 (2011), Paper 8, pp. 26. 







60 


THE UNREASONABLE EFFECTIVENESS OF NONSTANDARD ANALYSIS 


[24] Hannes Diener, Constructive Reverse Mathematics, Habilitationsschrift, University of Seigen 
(2016), Preprint, pp. 123. 

[25] Damir D. Dzhafarov, Reverse Mathematics Zoo. http://rmzoo.ucoim.edu/ 

[26] Martin Escardo, Seemingly impossible functional programs. See 
http: //math. andrej . com/2007/09/28/seemingly-impossible-functional-programs/ 

and http://www.cs.bham.ac.uk/-inhe/.talks/popl2012/ 

[27] Fernando Ferreira and Jaime Caspar, Nonstandardness and the bounded functional interpre¬ 
tation, Ann. Pure Appl. Logic 166 (2015), no. 6, 701-712. 

[28] Harvey Friedman, Some systems of second order arithmetic and their use. Proceedings of the 
International Congress of Mathematicians (Vancouver, B. C., 1974), Vol. 1, 1975, pp. 235—242. 

[29] _, Systems of second order arithmetic with restricted induction, I & II (Abstracts), 

Journal of Symbolic Logic 41 (1976), 557-559. 

[30] Kurt Codel, Uber eine bisher noch nicht beniitzte Erweiterung des finiten Standpunktes, 
Dialectica 12 (1958), 280-287 (Cerman, with English summary). 

[31] Amar Hadzihasanovic and Benno van den Berg, Nonstandard functional interpretations and 
models. To appear in Notre Dame Journal for Formal Logic (2016). 

[32] C. H. Hardy, Prolegomena To a Chapter on Inequalities, J. London Math. Soc. Sl-5, no. 1. 

[33] Jeffry L. Hirst, Representations of reals in reverse mathematics. Bull. Pol. Acad. Sci. Math. 
55 (2007), no. 4, 303-316. 

[34] Yoshihiro Horihata and Keita Yokoyama, Nonstandard second-order arithmetic and Rie- 
mann’s mapping theorem, Ann. Pure Appl. Logic 165 (2014), no. 2, 520-551. 

[35] Anton Jensen, A computer oriented version of “non-standard analysis”, Contributions to 
non-standard analysis (Sympos., Oberwolfach, 1970), North-Holland, 1972, pp. 281-289. 
Studies in Logic and Found. Math., Vol. 69. 

[36] Albert E. Hurd and Peter A. Loeb, An introduction to nonstandard real analysis. Pure and 
Applied Mathematics, vol. 118, Academic Press Inc., Orlando, FL, 1985. 

[37] Hajime Ishihara, Reverse mathematics in Bishop’s constructive mathematics, Philosophia 
Scientiae (Cahier Special) 6 (2006), 43-59. 

[38] Hiroyasu Kamo, Effective Dini’s theorem on effectively compact metric spaces. Proceedings 
of the 6th Workshop on Computability and Complexity in Analysis (CCA 2004), Electron. 
Notes Theor. Comput. Sci., vol. 120, Elsevier, Amsterdam, 2005, pp. 73-82. 

[39] Vladimir Kanovei, Mikhail C. Katz, and Thomas Mormann, Tools, objects, and chimeras: 
Cannes on the role of hyperreals in mathematics. Found. Sci. 18 (2013), no. 2, 259-296. 

[40] Mikhail C. Katz and Eric Leichtnam, Commuting and noncommuting infinitesimals, Amer. 
Math. Monthly 120 (2013), no. 7, 631-641. 

[41] H. Jerome Keisler, The hyperreal line. Real numbers, generalizations of the reals, and theories 
of continua, Synthese Lib., vol. 242, Kluwer Acad. Publ., Dordrecht, 1994, pp. 207-237. 

[42] _, Letter to the editor. Notices Amer. Math. Soc. 24 (1977), p. 269. 

[43] _, Elementary Calculus, Prindle, Weber and Schmidt, Boston, 1976. 

[44] Ulrich Kohlenbach, Things that can and things that can’t be done in PR A, Annals of Pure 
and Applied Logic 102 (2000), 223-245. 

[45] _, Applied proof theory: proof interpretations and their use in mathematics. Springer 

Monographs in Mathematics, Springer-Verlag, Berlin, 2008. 

[46] _, Higher order reverse mathematics. Reverse mathematics 2001, Lect. Notes Log., 

vol. 21, ASL, 2005, pp. 281-295. 

[47] _ , Foundational and mathematical uses of higher types. Reflections on the foundations 

of mathematics (Stanford, CA, 1998), Lect. Notes Log., vol. 15, ASL, 2002, pp. 92-116. 

[48] _, On uniform weak Konig’s lemma, Ann. Pure Appl. Logic 114 (2002), no. 1-3, 103— 

116. Commemorative Symposium Dedicated to Anne S. Troelstra (Noordwijkerhout, 1999). 

[49] C. Kreisel, Mathematical significance of consistency proofs, J. Symb. Logic (1958), 155-182. 

[50] Willem A. J. Luxemburg, A general theory of monads, (Inte mat. Sympos., Pasadena, Calif., 
1967), Holt, Rinehart and Winston, 1969, pp. 18—86. 

[51] Per Martin-Ldf, Mathematics of infinity, COLOC-88 (Tallinn, 1988), Lecture Notes in Com¬ 
put. Sci., vol. 417, Springer, 1990, pp. 146-197. 

[52] Antonio Montalban, Open questions in reverse mathematics, Bull. Symbolic Logic 17 (2011), 
no. 3, 431-454. 

[53] Takakazu Mori, Computabilities of Fine-continuous functions. Computability and complexity 
in analysis (Swansea, 2000), LNCS, vol. 2064, Springer, 2001, pp. 200-221. 









THE UNREASONABLE EFFECTIVENESS OF NONSTANDARD ANALYSIS 


61 


[54] James R. Munkres, Topology, Prentice-Hall, 2000, 2nd edition. 

[55] Edward Nelson, Internal set theory: a new approach to nonstandard analysis, Bull. Amer. 
Math. Soc. 83 (1977), no. 6, 1165-1198. 

[56] Dag Normann, Recursion on the countable functionals, LNM 811, vol. 811, Springer, 1980. 

[57] Horst Osswald, Computation of the kernels of Levy functionals and applications, Illinois 
Journal of Mathematics 55 (2011), no. 3, 815-833. 

[58] _, Malliavin calculus for Levy processes and infinite-dimensional Brownian motion, 

Cambridge Tracts in Mathematics, vol. 191, Cambridge University Press, Cambridge, 2012. 

[59] Erik Palmgren, A sheaf-theoretic foundation for nonstandard analysis, Ann. Pure Appl. Logic 
85 (1997), no. 1, 69-86. 

[60] _, Developments in constructive nonstandard analysis, B. Sym. Logic (1998), 233—272. 

[61] _, Constructive nonstandard analysis, Methodes et analyse non standard, Cahiers Cen¬ 

tre Logique, vol. 9, Acad.-Bruylant, Louvain-la-Neuve, 1996, pp. 69-97. 

[62] _, Constructive nonstandard mathematics, List of papers at 

http://www2.math.uu.se/~ palmgren/biblio/nonstd.html (2012). 

[63] David A. Ross, A nonstandard proof of a lemma from constructive measure theory, MLQ 
Math. Log. Q. 52 (2006), no. 5, 494-497. 

[64] _, The constructive content of nonstandard measure existence proofs—is there any?, 

Reuniting the antipodes—constructive and nonstandard views of the continuum (Venice, 
1999), Synthese Lib., vol. 306, Kluwer, 2001, pp. 229-239. 

[65] Walter Rudin, Principles of mathematical analysis, 3rd ed., McGraw-Hill, 1976. International 
Series in Pure and Applied Mathematics. 

[66] Abraham Robinson, Non-standard analysis, North-Holland, Amsterdam, 1966. 

[67] Nobuyuki Sakamoto and Takeshi Yamazaki, Uniform versions of some axioms of second 
order arithmetic, MLQ Math. Log. Q. 50 (2004), no. 6, 587-593. 

[68] Sam Sanders, ERNA and Friedman’s Reverse Mathematics, J. Symb. Logic (2011), 637-664. 

[69] _ , The Gandy-Hyland functional and a hitherto unknown computational aspect of Non¬ 

standard Analysis, Submitted, Available from: http://arxiv.org/abs/1502.03622 (2015). 

[70] _, The taming of the Reverse Mathematics zoo, Submitted, 

http://arxiv.org/abs/1412.2022 (2015). 

[71] _, The refining of the taming of the Reverse Mathematics zoo, To appear in Notre 

Dame Journal for Formal Logic, http://arxiv.org/abs/1602.02270 (2016). 

[72] Peter Schuster, Ulrich Berger, and Horst Osswald (eds.). Reuniting the antipodes: constructive 
and nonstandard views of the continuum, Synthese Library, vol. 306, Kluwer, 2001. 

[73] Stephen G. Simpson (ed.). Reverse mathematics 2001, Lecture Notes in Logic, vol. 21, ASL, 
La Jolla, CA, 2005. 

[74] _, Subsystems of second order arithmetic, 2nd ed.. Perspectives in Logic, CUP, 2009. 

[75] Stephen G. Simpson and Keita Yokoyama, A nonstandard counterpart of WWKL, Notre 
Dame J. Form. Log. 52 (2011), no. 3, 229—243. 

[76] Robert 1. Soare, Recursively enumerable sets and degrees. Perspectives in Mathematical Logic, 
Springer, 1987. 

[77] Keith D. Stroyan and Wilhelminus A. J. Luxemburg, Introduction to the theory of infinitesi¬ 
mals, Academic Press, 1976. 

[78] Patrick Suppes and Rolando Chuaqui, A finitarily consistent free-variable positive fragment of 
Infinitesimal Analysis, Proceedings of the IXth Latin American Symposium on Mathematical 
Logic Notas de Logica Mathematica 38 (1993), 1-59. 

[79] Kazuyuki Tanaka, The self-embedding theorem o/WKLq and a non-standard method, Annals 
of Pure and Applied Logic 84 (1997), 41-49. 

[80] _, Non-standard analysis in WKLq, Math. Logic Quart. 43 (1997), no. 3, 396-400. 

[81] Kazuyuki Tanaka and Takeshi Yamazaki, A non-standard construction of Haar measure and 
weak Konig’s lemma, J. Symbolic Logic 65 (2000), no. 1, 173-186. 

[82] Terence Tao, Entries on Nonstandard Analysis, 2015. Wordpress blog, 
https: //terrytao. wordpress. com/tag/nonstaindard-analysis/ 

[83] _, Structure and randomness, American Mathematical Society, Providence, RI, 2008. 

Pages from year one of a mathematical blog. 

[84] Alan Turing, On computable numbers, with an application to the Entscheidungs-problem, 
Proceedings of the London Mathematical Society 42 (1936), 230-265. 

[85] Martin Vath, Nonstandard analysis, Birkhauser Verlag, Basel, 2007. 













62 


THE UNREASONABLE EFFECTIVENESS OF NONSTANDARD ANALYSIS 


[86] F. Wattenberg, Nonstandard analysis and constructivism?, Studia Logica 47 (1988), 303—309. 

[87] Eugene P. Wigner, The unreasonable effectiveness of mathematics in the natural sciences 

[Comm. Pure Appl. Math. 13 (1960), 1-14} ^02, 7], Mathematical analysis of physical 

systems, Van Nostrand Reinhold, New York, 1985, pp. 1-14. 

[88] Manfred Wolff and Peter A. Loeb (eds.). Nonstandard analysis for the working mathemati¬ 
cian, Mathematics and its Applications, vol. 510, Kluwer, 2015. Second edition. 

[89] Chuangjie Xu and Sam Sanders, Extracting the computational 
content of Nonstandard Analysis, In preparation; Agda code: 
http://cj-xu.github.io/agda/dialectica/Dialectica.html (2015). 

[90] Mariko Yasugi, Takakazu Mori, and Yoshiki Tsujii, Effective properties of sets and functions 
in metric spaces with computability structure, Theoret. Comput. Sci. 219 (1999), no. 1-2, 
467-486. Computability and complexity in analysis (Castle Dagstuhl, 1997). 

[91] Feng Ye, Strict finitism and the logic of mathematical applications, Synthese Library, vol. 355, 
Springer, 2011. 

[92] Keita Yokoyama, Formalizing non-standard arguments in second-order arithmetic, J. Sym¬ 
bolic Logic 75 (2010), no. 4, 1199-1210. 

[93] _, Non-standard analysis in ACAq and Riemann mapping theorem, Math. Log. Q. 53 

(2007), no. 2, 132-146. 

[94] _ , Standard and non-standard analysis in second order arithmetic, Tohoku Mathemat¬ 

ical Publications, vol. 34, Sendai, 2009. PhD Thesis, Tohoku University, 2007. 

[95] The Univalent Foundations Program, Homotopy type theory—univalent foundations of math¬ 
ematics, The Univalent Foundations Program, Princeton, NJ; Institute for Advanced Study 
(IAS), Princeton, NJ, 2013. http://honiotopytypetheory.org/book/ 

[96] Homotopy iyp^ theory—univalent foundations of mathematics, 2015. 

http://homotopytypetheory.org/book/ 




